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Abstract 



t 4 



The ptirpose of this project was to^ consider the applicability of 
major models of organizational effectiveness for school systerfs and to' 
consider research on school systems in the context of' thk models'. 
Eight models were reviewed (i.e., rationalrgoal, mafcagem£S--by-obje<^ 
tives, fupctipnal, cost-benefit , systems-resoqrce, functional^struc- 
.tures, managerial, process, organisational development} V While all * >s \ 
models had features that were appJLicabiLe to sch*jl systenfe » all also v 
had major flaws as models to guide future research on school, effec- 
tiveness» Th£ most common problems characterizing the models were: 
1 J a - Preoccupation wlth^outcome^-measuranent wi£h little-consideration — m — * 
of "process 1 ' variables tfiafr lead to outcomes (e.g., management ^by-' 
objects, cost-benefit) j 2) the use of contaminated and deficient 

criteria such as pupil^gain scores on norm-reference^ . ability tests- or 

'- ' ' ' V . . • *' 

measures of job Satisfaction (e.g., functional, 0 systejns-resource, organic 

i. . . ... j * 

zational 'development,, Likert-ISR) ; 3) a lack of ,empiricai "support for ' 
the model (e.g., managerial process, fimctional'-structures/ functional)^ 
arid 4) a lack of 'clalrity, regarding major variables Related to the model \ 
(e.g., functional-structures, .systems-redource) . The managekent-by- * 
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* • * 

j< objectives #nd the Likert-Isa>odels were supported by- some. empirical' 

evidence within school' systems but all studies Involved deficient 
criteria. A "process" model of effectiveness model is propdsed-which 
talces. feature's- from several models, both, goal and systems-oriented. 
Organizational climate variables are included in. the model^along with 

components of the human resource selection, training, and evaluation ' 

f ' 

.processes for school systems. After critiquing research" designs used 
in- the past to investigate schooTvef f ectiveness , a design is proposed 

at would be -more sensitive to the\most salient factors related to 
ef lactiiveness . ' - - \ 
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The applicability of Organizational Effectiveness Models 

<* m • * 

» 

for School Systems 

r 



The purpose of this report is to consider the Applicability of the^ 

majoi: models of organizational effectiveness x fo& school systems. |^ecifi- 

cally, . the following models of 'effectiveness will be discussed: rational- 
I . * , \ % - 

goal; 2." mimagement-by^bjedtives; 3. functional; 4-, .cost-benefit; 5, >sys- 

'terns-resource; 6v functional-structures f 7. managerial process;'8*. organi- 

zational development; and 9. Likert-ISR. 

When considering the appropriateness of the models for school systems, : 

some difficulty was encountered in-classifying particular educational re- 

search as representative ^of one 'particular model*. : For example, research on* 

performance contracting wil!4>e discussed- in the context of tW rational- * 

gtfal- model of effectiveness though argument^ could, bd made.|oj; its applicar • 

bilifcy td other goal-centered .mqdels -such as. managem€nt-by-objectives. ^Tke* 

principal tas&n for, this difficulty lies Fitt* the conceptual similarities ' 

of -several- of the model*, (e.g., f unct;;Lona^ and functional^struc£ures; rational- 

-goal a^MBO; systems tfesotirce and co^st-benefit) . 

* ' * ** * * » ~ r * * ^ • / - • 

^ •* Also ^considered in the discussio^ of models are the various outcome 

\ , ' ^ _ » * j * - * • • ; * 

* variables that are.mgst often u*ed to t operation*!!** the construct of .organ!-' 



zational effectiveness. The appropriateness of these opera tibnallzations for 

educational systems will be discussed. It was the original lntent*of this" 

\ * . - " . ' V > * : , • - 

project evaluate' criteria ofv school system effectiveness in order to* 

arrive at. a« set of recommended strategies for -data collection. However i ^- 

j « > . - i , . * 

review of the ^iteratute in education .revealed* a paucity of detailed djfec^ 

siqn' of criteria bther than Student perfonwtnee on ability or achievement V " 



t * f r 4 \ 



» 



ERIC * 



1 , School' Effectiveness 



tests (e.g., Madaus,, Airasian,- & Kellaghan,^1980) . There will then be only 
limited discussion of the criteria in terms of psychometric issA such as 
reliability, freedom from bias or contamination, ^nd validity. 

* Variables- from the educational -literature £hat have been classified 
iato one of the effectiveness models will'be considered where sufficient' 

* data or discussion are available. For example rthe use of student scores 

• on achievement ability.. tests js results data in. an MBO model will be dis- 
cussed. Additionally, the appropriateness of ( the various units of. analysis 
available to the researcher in -education* will be -considered vis a' vis the 
models of » effectiveness . \ * * 

* Bidwell (1965) discussed .the paucity of systematic research, on schools, 
as organizations . There has been an increase recently in' .empirical research 
on the functional,, structural, arid technological processes related to edu- N 
cational systems.' Unfortunately, research on school Kef fectiveness, like its' * 
counterpart in the literature on organizational .effectiveness a.t large, has - 
been largely fragmentary, discontinuous, and unidirectional. School. effec- 
tiveness is almost ^always viewed 3n J&erms <tof one-criterion and that most 
frequently -is some measure of student outcomes. While there has been a. 
plethora of position papers supporting programs of accountability, performanc^ 



3iippor 
Lon^c 



contracting, program evaluation Kpompetency-based assessment, performance 
objectives, and organizational change, well clofctrolled empirical research 
bri models and/or**the measurement of effectiveness is rare. THis'may be due 

to" the fact that early large scale projects" relating school characteristics * 

^-^ * •, ' ' •'• > - ' 

fa outcome measures bore little fruit. In. one of the first major works in , 
this area, Coleman, Campbell, Hobson,- McPartland, Mood, Weinfeld, and York 
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(1966) concluded that "schools -bring little influence to bear on a child's ' 
achievement that is 'independent of his background and social context" (1966, 
p. 325)1 Subsequent reanalysis. of the. Coleman et al. .data and other similar 
studies have arrived at essentially the same conclusion (e.g., Jencks, Smith, 
Acland, Bane, Cohen, Gintis, Heyns, & Michelson, 1972; Mosteller & Moynihan, 
1972;. Postlethwaite, 1975;. Smith, 1972). Research on educational interven- 
tions 4iPh as Project Talent . Follow Through , and 'Head Start is also in 'line 
JJith the statement 'above by Coleman et al'. (1966), (e.g., Averch, Carroll, 
Donaldson, Kiesling, & Pinctis, 1972; Jencks & Brown, 1975; Madaus -et al., 
1980) . There are some, studies that have found school characteristics --' 
accounting for significant ^portions of the variance in student outcomes (e!g., 
* Bidwell & Karsarda, 1975; .Cirirelli, Evans, & Schiller, 1970; Hanushek, 1977; 
Mayeske, Cohen, Wisler, Okada, Beaton, "Proshek, Weinfeld, S.Tabler, 1972; 
Mljtchell, 1977)'.- . However, criticisms of many of' these findings have been made 
-^statistical or methodological >grounds (e.g^ Alwin, 1976; Cronbach, T976; 
Ditta, 19,76, Hannan, 1971; Haunan,. Freeman, & Meyer, 1976; Lau,* 1977; Madow,- 
■ 1969; Young & Erbring, . 1976). . • * 

. In summarizing the long list of .'point-counterpoint articles/ Madaus et 
al. (1980) noted- that "insights , into .the schooling process itself and the 
way in whlch'that process.* is .best viewed Were* often"' slow to -emerge.- Much^ 
of the debate has overlo oked q uestions abW .schooling and' school effective- 
ness .and the most useful manner in which to conceptualize, these concepts" 

* - " ' • t < ■* a * 0 

(1980, p. 44) . Hopefully, ' one or more, of : the models to be discussed on the 
following, pages' can serve as a framework" for this' conceptualization . ' " 
' ^ Before discussing the appropriateness of the" various models of organic - 
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zational effectiveness for school systems, it is first necessary to put this 
research in-proper f&cus regarding two major issues. The first issue has to 
do with the types of schools to he cdnsidered in the context of the .models 
of 'effectiveness. There are great differences between the various institu- 
tions that come to mind when thinking of schools in general. The discussions 
to follow will focus on the appropriateness of th€ effectiveness mpdels for 
public elementary and secondary mainstream school systems. . The inclusion ^f 
private schools or colleges and universities would necessitate major critical 
diversions from the more generic characteristics of school systems. However; 
where empirical research seems particularly pertinent, some discussion of 
other Educational systems will be made (e.g., the use of cpst-benefit analysis 
for 'special educational programs'; college .student evaluation as^criterla for / 
teacher effectiveness). Also, an excellent discussion. of organizational . 
e&ectiveness for higher edudation can be found elsewhere (Cameron, 1978). 

: The second issue has to do with the comprehensiveness of the discussion 
of ma^r topical 5 * areas such as accountability, performance contracting,- * 
'criterion-referenced instruction, , instructional or performance objectives, 



program evaluation, cost accounting, ^competency-based programming, teachfer V 

* \ 

evaluation, educational assessment, <Jiffere6tiated staffing, PPBS,*PERT, 

v MlS^-and a host of others. It was never the purpose of this" project to 

review -all of this^ literature ti\at is obviously at least tangentially re- 
A lated to a- ubiquitous construct Suctr as organizational effectiveness. \ 
jjfe, Rather the focus in the discussion to fpllow is on the applicability of the 
^ .various models and criteria of effectiveness. Where research related; to 
accountability, contracting, etc., fits within one of the models, it will*be 
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Included. An 'attempt has been made to incorporate most of the better re- 
search and .discussion of sufch topics into the paper. ^ 1 . ' 

Discussions of - the various 'models will differ substantially in length 
due either to the appropr£ateness/inappro^riateness of the giodel* for school 
systens^and/or the exten$ to which research or discussion in educational 
literature indicates support/nonsupport for the model . v Also*, there may be 
longer discussions o£ nob-educational research for some models when that 
research is considered pertinent and there 'is little educational research - 
available (e.g.? the managerial proces? model).. - 4 * 

This report will begin with w a brief introduction to the concept. of 
"organizational effectiveness" and point out some of the difficulties wi£h 
measuring %t. The various models of" effectiveness will .then be duste^W * 
-and discussed within either a goal-centered or "systems" perspective on ef- 
fectiveness. , To that' end, the authors are indebted-, to' the excellent work 
of Campbell, Bownas, Petersbn, and Dunnette (1974) w}io summarized and cri- , 
tiqued the plethora of- research on effectiveness up .through 1973*. Research 



and discussion subsequent to this date will be the focus of this report.. 

* * * r * * 

Organizational Effectiveness^* M Introduction 
* There is a notable lack of consensus as to -what the construct of or- 
ganizational effectiveness actually means (Steers, 1976). Pennies (197&) 
notes that the literature is rather diverse in its prevailing .definitions 
of organizational effectiveness ^ The research and. debate is,^ for the' most 
part, noncumulative and disjointed. There is agr^ement^hat organizational 
effectiveness, is a desirable state of affairaf, but thSFis . concomitantly - 
a lack of firm theoretical basis for measurement of the construct. 9 Ghorpade" 

'3m 
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, (1971)- states that a researcher undertaking a" study of organizational ef fec- 
tiveness is faced with -two major hurdles at" the' theoretical ;evel: ~Ta) . 
.there does." not seem to be a substantive, systematic, body of knowledge based 
on hard evidence about the functioning, of of ganizations ; and (b) there does 
not seem to.ba a universally accepted theoretical framework for approaching^ 
the study of organizations. Unfortunately, these .hurdles also apply to re- 
search In education, . If organizational ^theory is itself still in such a *• 
confused state of affairs'Tit ik small wonder that, studies pf the effective- 
ness of these structures are in such turmoil. '. 

- , This state of turmoil is clearly illustrated by the multiplicity of 
criteria that have been used to assess organizational effectiveness. A 
large and^often conflicting array of data has been* amassed and purported 
to demonstrate effectiveness. Campbell et al. (1974) note 26 separate cri- 

• • • 1 

tgria that have been used at one time* or another in the- literature. They * 

conclude that a better way -to &ink of organizational effectiveness is as 
• • • ' . . * • . s > - • • / • • . * « 

an underly ing construct which .has no direct operational definition, but 



which constitutes a model or theory pf' what- organizational/ effectiveness is. 

* * I ' 

The f taction of such a model would be to identify the variables of interest 
and, tell us' how they are roi*^, ; / f , • 



In part due to the lack of agreement concerning ' thjk criteria of organi- 
Rational effectiveness, it is' no surprise that there is also conflict con-' 
ceroing t;he best methods fdr its "attainment. Steers (1976) notes that a 
major reason for this lack of. agreement is .the parochial view that many ver- ' 
searchers take toward the construct. Effectiveness is;often viewed in terms 
,of a single criterion ''that is person or situation specific Ce . g. , prof it", 
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efficiency, output, etc.), even though organizations are known; typically to 
' pursue multiple goals that are modified -across personnel ,*• technologies, 

socio-cultural environments,. and a host .of other factors. Yet, most *of ten, 
.the attainment or failure, to attain one goal is treated as -a .dependent' var- 
. iable and* the* larger context is ignored. As-will be discussed "below., re-* 

; •? • ' ■ ' ' $ ' '. 

^ search on school systems* effectiveness .can also^for the most' part,' be 

characterized as parochial in nature. * N «. 

• «• ■• 
A second reason for the lack of agreement concerning effectiveness 

• *' 

attainment is the* ambiguity of the concept* itself. Many, models of * organi- 
zatLonal effectiveness are somewhat esoteric and the criteria are difficult 
to' operationalize.. Both the models and the criteria may b^e persqn-viewpoiht 
specific, dependent mainly oh the frame of reference of the evaluator. 
Steers ,(1977) ," for example, reviewed 17 different studies encompassing as 
? many different multivariate- models of . organizational effectiveness. He " 

* found, that only^one criterion Xadaptability-flexibility) was mentioned in-' 

• . * .• ; • ' * *• *»m 

ntt re^ than half of the models. . Thus, "there is^ little agreement about the " 

conceptualization or measurement of organizational effectiveness. In edu- 

• cation, there is a general consensus that" some measure, of. student outcome is 

-.-^-he-aost-apptoprlate ciltei lo ti on^wh1;cg^Ws-eTs"cre^ However, 
*' • » 7 • . - / " \ ; • ' 1 

there is also, a; consensus that all such measures have problems (Madaus et ' 

al., 1980). The literature on organizational effectiveness is most often 

divided theoretically into two major perspectives. While the nomenclature,, 

' varies somewhat, th^two" most popular labels for those perspectives are the;* 

goal-cerftered and the systems view (Campbell et al., 1974; Ghorpade, 1971). 

... / j 

The framework for the discussion of the specific models within' these 
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two perspectives is as follows; 1) a. general discussion of the meaning of • 

the models and definitions of all pertinent terms; <£) a consideration of the 

applicability of the model for school, systems; 3) a review ef pertinent re- 

search in education; and 4) (where possible) , a discussion bf implications 

■ *t • 

pf the model for the practitioner in- education. 

. » * 

Goal-centered Models 

* , •*■ 

The goal-centered models make the assumption that the organization is 

\ - I 

in :the hands of a set of rational decision makers who have in mind a set of 
goals,, that are reasonably explicit .and for which the organization mobilizes 
its' resources (Campbell' et al., 1974). It is further asstnded that the goals 
are reasonably well defined and few enough in .number to be manageable. 
Given this, it should be possible to develop, a strategy for the attainment 
of maximization of these goals. Effectiveness criteria would then be defined 
in terms of the degree to which stated goals were achieved, of as Price 
(1972) views it/ the degree to which the organization achieves ideal end- 
states. * re- 
steers (1976) notes ttfb basic variations of goal-centered theories that 
dichotomize the field. * The model proposed by Thompson and McEwen (1958) iri- 



.corporate* .those factors external to the organization that can influence 
the' selection atid modification of organizational objectives. This model 
focuses *»;the relationship betweei^&a organization and its environment in 
***erence tartjxe balance of power. The second model, by Cyert and March 
(1963); deals prtixl^imlly with internal forces. It focuses on the internal 
determinants of goals by "coalitions of individuals and groups. -This dichot- 
dmy of focus between, internal and external .holds true-, for many of the .models 
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.to follow. Some models, howeverTle.g. , MBO, cost-benefitj ate influenced 

- — . — - * • « 

"by both Internal and external forces in the selection and modification of*' *' 
objectives* . " . % . 

The goal-centered approach views organizations primarily as rational devices 
for the attainment of certain objectives. Goals answer the question of 1?here the 
organization is going. - Steers (1976) , however, questions this simple concep- 
tualization of goals on several logical and methodological grounds. For 
example, one can ask questions such as whose goals are we talking about? In the 
context of school systems, is the reference group te&chers, students, par- 
ents, administrators,, or whom? There is also the problem of multiple and 
' often conflicting goals* Who decides which goals are more important, and 
how is this decision made? Are they system-wide*goals or strictly 'school- 
specific goals? What is the rtin%,r6faapnce? Given limited resources, what 
will the organization do? Thus, according to Steers (1976), the simple de- 

* * C 

finitions of goals that are usually given may be useful on a fairly abstract 
level, but they lack the precision necessary for examining empirically the 
relationship between organizational goals and organizational, effectiveness. * 
Yuchtmaa and Seashore (1967) agree, stating that goals as ideal end states- 
do not offer the possibility of realistic assessment. • . I 

At this point a distinction must be made between the various types of 
goals toward v^ldi an organization may be striving. The most common dis- 
traction is that of official, operative, and operational goals (Pelnrow, 
1961) ♦ Official goals are fomlal statements of purpose made by executive 
management concerning the nature of an" organization's mission. These goals 
>re ; txj*^^y vague, aspirational, and set: in an infinite timetable. 
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Operative >gpals represent the real- intentions of an organization;) that is, 

— . . '■'?. . •* ' " / \ 

what an organisation is really trying to accomplish rega/dless of what it 

sayd it is trying "to doV Operational goals are goals for which^there are 

agreed ugon criteria fo^valuating the degree to which, an organizations ' 

activities are contributing to goal attainments Goal attainment here }s 

operationally defined in. terms, of unit production, profit levels, etc. 

> . , ' * • • .• ' • ' 

Sheers. (197&) and Reimann (1975)" both agree -that assessment of organizational 

effectiveness must fpcus on operative goals. If it does not, then .the' con- 
cept of a. goal-directed system has little meaning. 

■ One shortcoming^ of the goal approach is that some goals arise as cul- 
tural entities, derived 'from societies.' expectations and demands, and thus 
are not applicable for, analysis. Of particular Importance here is the con- 
cept of "goal relevancy. Although goals may be Important to some, segments of 
the organization (and, tif^Mptt&m^^o some segments of society) they may 

: ; • . * • - \ 

not be to others. In tact, soie segments of the organization may attain 
their goals.at £he expense of other segments. Seldom, however, do we examine 
this multi-goal, environment within, which * the organization operates (Kirchhoff, 
1977). " • . 

> 'A second shortcoming is that the approach has limited usefulness, for 
studies of comparative effectiveness across organizations. If we accept: 
the notion that the only valid indicators of an organization's effectiveness 
are inoperative goals, then measures of effectiveness will be Afferent 
-for .**ch organization. Although this approach may have practical utility 
for any giyen case, jLt would be prohibitively restricting .for any theory of . 
organizational effectiveness. ' 4 * 
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■ Indeed, Price (1972) summarizes his review, of goal approaches "by c6n- 
eluding that. they have not successfully measured* organizational effectiveness, 
Kirchhoff (1977) notes further that current empirical methodologies do not ♦ 
adequately express the complexity of effectiveness) measurement. ^ 
A third issue concerns the actual measurement of goals (i.e., the 
"criterion problem")* This issue will be examined in depth in the manage- 
ment-by-objectives section. , % * 

r 

Presented iri? Table; Lare four goal-oriented models of organizational 

• ■ * \ * 

effectiveness. We now turn to a discussiotl of the applicability of^each of 

'those models, as a vehid'eby which to assess a school system T s effeclilve^ 



ness« 



ert Table 'I 1 about here 



The Rational ~Goal Model * ^ ^ " 7 

l z _.JEhe~basis of thfe rational -goal approach is the Weberian concept of 
functional rationality. ' According to Weber (see Steers, ,1976), modern or- 
ganizations are* characterized by networks of roles, divisions of labor, and 
^hierarchies of activities (i.e., a typical bureaucracy).. When an organiza- 
tXoa is effectivei; every element has a defined role or function that is logi- 
cally related* The organization is evaluated !>y comparing those goals that, 
were established with those that were actually accomplished. Thus, an effect 
tive : organization is one : tha:t has achieved, the goals" that it has set for 
itself (d.g.^tzioni, 1964; Perrow, 1961). Criteria are established based 
on either the former or . informal (operative) goals of the organization 
^unaingham, 1977). ^ 
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V 

, In/a discussion of elementary education/ Lortie (1969) maintains: that 

\ , ^ ■ - , ' ^ ^ ' ' — 2 ' — rr"~ 

\ goa^ statements are generally stated at the level of the school board and ' • 
,due tb £he±r genera! nature, it is difficult to^fine criteria wkich vould 
determine the. extent to which the goals 'were successfully achieved* Dorn- 
busch and" Scott (1975) /> however, argue that the goals at the elementary 
level could~Be far more explicit than goals established, for example, at 
institutions of higher education. Cameron (1978) , on the other hand, shows 
Empirically that 1, dominant coalitions" from six jfos^ifritions of higher "edu- 
cation cag, agree for the most part on a list >& s imporj?ant criteria on 'which 
ffo assess ef f ectiveness • It may very well be* that disagreement, however , would 

/flourish as soon as any detail^ was required for the ambiguous criteria re- 

* \ * . j „ 

ported by Cameron (1978) such as ''student educational, satisfaction 11 , "acad emi c 

/development", or "professional development <and quality of the faculty". • 

* * j * * ' 

I Nraerous criticisms^ have been levied against the^ rational-goal model of 

effectiveness. Blau and Scott (1962) and Scriven (1967) state that there is 

a preoccupation with formal -or official goals to .the exclusion .of multiple 

constituencies affecting organizations with their informal, operative goals. 

While this criticism may have been true of goal-ottented, 



, educational models 



in the past, there lias been a substantial increase in consideration, of 

operative, and more quantitative goald of school systems from /relevant con-* 

stituexiciqs (e.g., Nash, 1970) . Thus, whereas* goals' may have' been defined 

earlier as, for example, "to impart skills in languages and mathematics" 

^ - . v , ' ' 

Ccf7 Beshers, .1972), recently the method of assessing performances in these 

areas and the' extent of improvement are very often made explicit (e.g.* 

Barro, 1970). The increased Interest in performance contracting is a 



/ 



• 



4* 



S^hooi Effectiveness* 

* • 15 . N 



„ , v j . — 

.reflection of this greater concern for actual performance measurement to > 

' ' ' ' » ■ * ' * *>' ' * r 

assess goal achievement. One of the better 'examples of an educational study 

to assess operative goals 'is the "large scale project on performance' contract- « 
ing sponsored bjr the Office of Economic Opportunity in .1970-71 . Due to its . 
implications in assessing the rational-goal model of .effectiveness; dis- 
cussion of this"* study v will follow shortly. '. : * . 

A second common criticism o;: t^he rational-goal mo'del is that there is x 

, . a general neglect ,of the confUc :- or. potential J$hf lie t* of many organiza- 
tional goals (e.g., Sice, 1963). This criticism is quite appropriate for 
school systems given the multiple constituencies concerned with their effec- 
tiveness-~(e.g., politicians/ cpmmunity leaders, teachers, parents, students).- 
The goals, of these various constituencies will certainly conflict at times; 

^"as, for exam p le,, in considerations of .teacher salary and absenteeism policy, 
. budget TactorsT W 7 «tMcurricular activities^. ~~ * ' ~~ ' *~ 



A third criticism' of the rational-goal theory is that the interactions - 
A ' of ; .. aa organization's goals with' the goals of the affected environment, are not 
ttaken into consideration (Lawrences Lorsch, 1969). .Thus, for example, * 
operative -goals of the school system <such as "equal employment opportunity" 

* % „ ' * f • 

may be influenced by the informal goals of the organization's boundary in- 

* • • * * 

stitutions such as \ the local or regional affirmative action office or the 

racial make-up of the school board. Also, environmental factors such as 

the socio-economic .characteristics of the school community can have a 'signi- 

£ icant impact on the types of goal* and the measurement strategies established 

to assess goal attainment (Averch.et al. f 1972). . 

final criticism of the model. ^s i that it treats goals a$ .static in an 



\ 

N 
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environment lhat realisticall y should maket^aTLoperatlve-gQal ^Ajna-mi ^ 



- 4 



(Pfeffery 1977). . Although the formal goals^ of a. school system may*be ** 
constants, "the operative goals may be affected by. contextual factors. For 
example, the operative g<Tals-of-teachers could change significantly as a^* 
function of some budgetary decision (e.g., working to contract due to low ■ 
or no pay raises) . ' " 

Performance Contracting. Kith, performance contracting, the focus is 
on-$be school systems', teachers or outside agencies ability to achieve 
certain explicit goals related to education* outcomes ( Gra mlich & Koshel, 
1975). Thus, goals. are formalized in terms of end states, a time reference, 
.and "hard^ criteria (e.g.; average scores at or above a certain score on a 
specific test or tests). For example, in 1969, Dorsett Educational System 
contracted with two school systems (in Texarkana, Arkansas and. Liber ty- 
«- Eylau, Texas) to teach certain academically deficient high school 'Students. 
The performance contract explicitly stated that' Dorsett would- belaid only 
.for^hose students who attained a specific level of proficiency. The pro- 
gram- involved more than 200 students, and seemed to work amazingly well, 
*' exciting many in educational circles to the possibilities of performance 
contracting as a way of making schools more accountable for the outcome of . 
% their students. However, the validity of % test score gains-*=in- Texarkana has 

• • * 

- since been' questioned. Dorsett has been charged with contamination of the 
, .results by teaching sp&ific items on . the test to Students (Educational 

Research Service, 1974). * 

:.- As a result of the. Dorsett s£udy, the Office of Economic Opportunity • 

(0E0) decided to perform a national experiment designed to assess the 
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'^relative advantage? and disadvantages, as well as the practicality of per- 
formance .contracting for use with academically deficient children* 
\ • The evaluation instrument used was the Metropolitan. Achievement Test, * 

\ V \ / r * 

a battery of t^sts including readthg and mathematical components . 

Of an original 'sai4pl& of 24,000 students/ 81 percfljit -actually parti- ' 
cipated in the -entire program with only 61 percent -having scores whifo V •< 
could be evaluated. There were slight <&f f erences- betw^x , the number of 
students in the control and ' experimental group who were both full time »• 
students- and took pre- and post-tests -(74 percent of the control groups 4 as 
compared to 77 percent of the experimental group) . Gramlich and' Koshel 

, (1975) stated that these differences "suggest that a disproportionate attri- 
tiomcould be responsible for a small bias against^he" Students In the ex- \' 
periment, especially if pthe experiment was 'itself responsible for the lower 
attrition in that group" (p. 32). 

The differences between the various ^ subtests in both experimental and ' 
control groups were relatively small, showing that the student* did not demon- 
strate a tendency to do better in one area than any other./ One interesting 

"difference found was that in the subjects not taught by the contractors ' 
(spelling, word analysis? etc.) the experimental -students did slightly w«rse. 

jOne reason for these differences might have been that students in' the ex- 

frimental \group may have missed some instruction in other subjects due to 
ineffective and haphazard scheduling or other disruptions. Other -interpre- 
tations, of course, are possible. F<?r example*, teacher bias may have affected 
the results. The . teachers could possibly have been, biased against those' 
students in ,tbe experimental group, thereby giving. 'them, less attention. 
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-this- could" easily be the case', for the idea of performance contracting was 
viewed as a threat by many teachers. As will -be discussed later,; many of 
thft*£eachers were indeed 'uncooperative and sometimes hostile in regard- to 

* * • \ . . . „ H 

the progranu _ / . . 

-r » 0 « * 4 ~ t\ ^ 

Since in most cases, achievemlnt gaiiis were positively related to the 

' pretest scores, and since these scores .were not equivalent^ in ^experimental • * 
• . * ■ *" 

and control groups (the experimental gtoup^was usually lower) these gains . 

were adjusted. The. adjusted mean gains are 'perhaps tie best* measures . of the 
actual differences between the two-groups. "They show statistically 'signi- 
ficant experimental gains fpur times, '.one statistically significant' experi- < 
■mental loss, and very small gains -or loesses in the other seven cases" > • 

(GramUch & Koshel, 1975, p. 39). . * * 

« ' ■ *• • 

Overall, £he adjuste4 e^rimental^ains. average - about 0.04 grade 

' * * ' ' \ \ • ' * 

equivalent units, a seven percent gain ovet that of student^- in* the control 

group/ These restilts were disappointing to those involved, and forced 0E0 

to conclude that-£erformance contracting proved no more effective than re-' 

gular teaching, methods in improving the level of academically deficient '* 

students. . 

• - — * « . » 

•Although 0EO|s findings did not suppor^perf o'rmarice . contracting, many 
have pointed to numerous flaws in the design, procedure, and implementation - " 
*of the experiment.. , The first of these' flaws had to do with the' lack of - 
r time spent organizing the -experiment. 4 , 

Also criticized was the length of the experiment. It has been suggested 
) that one\year not enough time to evaluate, the "amount .of cjiange^ performance ' 
^contracting is capable of- prpdu£ng. Indeed, according - to some, this lack of 
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. » extensive ^valuation prevents the results f«£t demonstrating any conclusive • 

• ' * * . ' 

t evidence whatsoever. Thus, Vthe'^OEO experiment sWed that private enter- - 

prise .could not provide existing schools a royal road- to^educational qua^.ty 

*- • vithin one year . ' . . Beyond this- conclusion,^ "however, the- experiment le§t 

. ~ • , 1 . • 

many questions unanswered 1 ' ,( Carpenter-Huffman" et al'.,- 1974, a. 52). * 

-A third time-related problem deals with^differential amounts of time' 

devoted to .experimental and- control : j^oups i \Ut\wdtkd .se^' 'then that the 

differences in mean achievement gains between experimental and" control * ' 

groups did not depict a very, accurate account of the relative merits of per- 

formance' contracting-. The 'experiment ;wouTd.have been much more informative' 

had this time, element been held constant* * * . ' « ' • ** 

' . A more serious criticism of "the 0E0 experiment has to do with 'the pro,- -\ 

cedure for designating schools as "experimental!' or ,f control . " ~& previously 



^stated, this status was determined on the basis df .academic need* £onse- 
* " ' ' *'->.'. \, V • \, 

t quently, the control and experimental groups* were not evenly matched in terms'^ 

of ability. .This uneven matching r con»titutes a* serious flaw in the- experi- 

» « *■ - ' ** 

-mental design. In particular » a design-wi'th'nonecuivalent <,groups..runs\he 

. ■- - r— - ■ 7 — " > "7 • • \. 

risjc of maturation effects being mistaken" fo^: the effect of the variable/ ' '. 

thus affecting the internal valid^t^ of 'tee; experiment. The 'external vali- • • 

• ~ • ft », . , 

dity is also thjeaten/d by. the effect of the interaction of testing and 'the 

/ : " J v •' r v>< ; 

, •. 'treatment. If either of the groups are selected for tAeirextreme scores, 

* . * * * 

^ the difference in the degree-of shift. from pre-^to post-test may be a product - 

. y ' •»'.". , ». 

* of ..regression rather than' the effect of^ the, experimental condition^ Indeed, 

*^ ln their statistical: analysis of -the experiment, Carfinkel andf Gramlich 

.<?*^ ion that "one > must be extremely/ caxefu^' ln> .interpreting experimental 

: " >vv © ; " : • 4r - ' , . 'J:$£ • . • ' • ' ' 
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results if there is some "indication that the 'sample is imperfectly matched" ' 
(Garfinkel' & Gramlich, . 1973, p. 284). ... 

• Another area of great concernwith ' respect to the experiment involves 
perhaps the major problem with rationale-goal programs such as contracting, 
^namely, that of the criteria" that are used. The contracted firms questioned 
the -content validity of < the criteria, claiming that the Metropolitan Achieve- 
ment Test did not sufficiently match the content of their' program. * Indeed, 
in addition to the firms, many' have 'questioned the use of standardized 
achievement tests to assess present capabilities of a student jjteee for 

. example, trophy 1973; Hall, ,1964; Sogf*& Soar, 1977) » While some of this 

■>■ ■ - > • ■ 

discussion will" be reserved for the MBp section of the paper,, a comment must ' 
be offered on the suitability of standardized,, norm-referenced tests as 
criteria in. contra^fihg~~aha~6Wr accountability programs . . ThV validity, 
reliability ,' and relevance of such vtests for use as criteria of school or 
teacher effectiveness has/been questioned by numerous writers {e.g., Airasian 
& Madaus, 1976; Coleman,' lf?5; Kellaghan, 1977; lewy, 1973; 1 Madaus, Kellaghan 
Rakow, & King, .1979; McClelland, 1973). Madaus °et al/(1979) ask the rhe- . 
torical question whether verbal ability^tests such as those frequently, used 
in contracting or voucher programs adequately sample the content domain that 
schools attempt to teach. Coole*y and Lohnes (1976) contend that while such 
tests are certainly not perfect, they are the best thing we have available. 
Ot£e"rsr(e.g., Fopham, * 1970) recommend IT form of criterion-referenced testing 
to assess" school or teacher effects. Madaus' et al. (1979) agree, stating 
that tests should -be used that are more congruent with the specific school 
curriculum and instructional methods. 
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Additional problems with. the 0E0 study concern the physical conditions 
under which -students were .tested at certain sites, and' the participation (or * 
lack thereof) of parents, students, and in particular teachers. Many teachers 
.opposed the program because they felt threatened by tihe entire performance ' 
^contracting ^idea. It seems quite reasonable to suspect that some of this 1 
. dissatisfaction with the' project may have biased teachers against students 
ln^he experimental program. * If this were .so, one. might expect to find that 
these students di/d not perform well on *ther subjects taught by the teacher. \ 
In fact, this result was found. "* 

Given the lack of planning time, unsatisfactory methods of measurement, 
.*'••«' " . ' * 

insufficient, assessment time, and poor research design,- it seems the only ' 
S|L - : ' * • a * ' > " ■ ' . 

conclusion one can draw from the OSOj study is that there, was a lack of plan- ** : 

fling 'time* unsatisfactory methods of measurement r # Thus, one can say that" 

■ * — . • • " « v * 

this experiment did* ndt snp^ort^he idea of* performance contracting, which ' 
is not to say thlat./'perf^rmance contracting must therefore-not work*" ' 

. The 0E0 and Dorsett studies underscore some of the problems with the 
rational-goal' model, of organisational effectiveness as^ applied to ^sc§oql * 
systems. While operative,' quantitative goals are stated, they typically " 
do not represent the domain of formal goals .for a school system. The result, 
as in the^.OfiO study, is a* preoccupation with those goals wMch can be for- "~7 
mally measured#> The conflicts of multiple^onstituencies regarding goal^ 



are also evident in the perfprmance contracting framework. A concentration 
on" certain educational outcomes as end-states woul& inevitably result in 
^onilicta over appropriate means for facilitating such end-states^ between 
^students,: pa rents , principals, and teachers. The hostility of teachers to 
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the 'notion of performance contracting is also typical of reactions to goal- c 
oriented management approaches which do not base specific end states on 
Input from those most affected (Dornbusch & S<f8tt, 1975) . 

TJie discussion of the 0E0 project -was presented .to accentuate s&me of 
the problems common to performance contracting in general and to a rational- 
goal approach to educational accountability. . Sim il ar critiques could' be 
made of other rational-goal approaches; to aqfcqjmtability programs such^as 
•voucher plans (e.g.; Fobert, 1977*). Critics of contracting view such pro 1 ^ 
blems as either insurmountable (e.g., Hbttleman, 1971) or in dire need of 
attention before ^wholesale* adoption of such an approach (e.g., Gramlich & 
Koshel/i975; Mayrhofer, 1972). Mtecklenburger ' anji, Wilson (1971) present 
a case study of some of the problems^ with performance contracting in a 



large city system. As in the dispussion of .common criticisms of/ the rational- 

*gQ4l model of effectiveness (e.g., Blau & Scott, 1961; Cameron, 1978; Rice,^ 

; 

1963); MecklenburgS^and Wilson JWI), cite the conflict of operative goals 
e across^ the various "Educational constituencies as the principal cause of ' ' 
discord with contracting^ Teachers -'tend to view performance contracting as 
.a punitive measure to be used only a^ a basis for firing people (Gramlich' 
& Koshel, 1975) . The use of contracting in any sort of teacher incentive 
framework is rare and^not well received* by teachers anyway (Nation's Schools, 
1970). The reaction is not unlike the ^common reactions to other goal-oriented 

y x . . 

programs such as management-by-^ob j ectives (Levinson, 1970).' 

A major criticism of the rational-goal model that appears to be ade- 
quately handled by schoo^ accountability programs such as c&ntracting *6r 
voucher^' is the belief ghat* organizational goals are. retrospective in nature 
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and serve only to justify action, not to* direct it (WeUclC 1976)-. Under 

most acceptability systems there are at least formal, <Long-term goals sep 

■ v . 

with changes made in criteria for effectiveness prior to teaching.^ For. 

\ - ^ ■ V 

example, McDonald's (1972) accountability) system for New York' City included 

a provision for periodic 'review and revisions *of all "program objectives (see 

\ * ' „. ' 

also Alkin, 1973; Barro, 'l970;. Lieberman, 1970; and Lopez", 1970)-. Thus. 

■ 4 " *" * ' * 

many accountability programs do view schools as open system^where goals 

and criteria are changeable". ■ , 

W / 

For the' practitioner concerned with assessing effectiveness with the 
goal of improvement,' the problems of conflicting goals and constituency in- * 
volvement are person-specific, not approach-specific, and can be* adequately 
handled by a '"cascading process" In goal-setting.. In this approach br>ad • 
'objectives axe, set at- the school board level and filtered down^Lnto specific 
goals at the school level. In -this way|fell who are to be affected take t' 
part in the goal 'setting process. This should result in school-level 'goals 
tha* are compat2b||gwith broad system objectives and at the same time foster * 
a feelijag* of cohtfsiveness throughout the entire school system because^] 
involved are working "toward the dame' goals. fc * 

XKere remain, however, some problems' that are approach-specif ic making 
the rational-goal approach questionable as a framework within' which to assess * 
a school system 1 s effectiveness/ First; the approach is ct^tcerned only with 
Outcomes. There is no mention of tew goals ate to be, accomplished, only 
that they'shpuld be* This outcome orientation results in a second problem. 
Th» rationalrgoal approach, by concentrating on "ends", will by its very 
nature, emphasize those skills that are* more" .easily measurable, .--at j:he* 
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■ . exclusion of- other skills* As a practical - matter, this may result iu a ' 

r ■ • ** . . 

ccmqentration by teachers on the basic skills which are measurable by 

■ staadardized achievement, tests at tke expense of more abstract skills. 

This. brings us to the f3§|l problems- the measurement issue. This issue 

along. with the two previously mentioned criticisms will be returned to 

after a description^of the managemeht-by-objectives approach since they are 

relevant to both approaches. i 

■ Mflnagement-by-Ob1ectives "fedel . . 

.:>■ Many researchers viWmanagement-by-o&jectives (HBO) as a complete -sys- 
tem-, of planning. and control interfaced into the organisation (see, for 
. example,, Campbell" et al., 1974 and Odforne, 1965). However, the basic pro- 
'gram of MBO originated as a mechanism, or, device,^ the activation of which 
" would result in increased .performance and organizational effectiveness by 
carefully formulating organizational goals, iu terms of quantifiable results 
.and the behavioral directives needed to achieve them. This initial fonrai- 
Ration, though, was soon augmented by alneed to confirm results, and to 
implement cooperative planning, and behavioral intervention, as initial 



attempts to engage the "mechanism", were seen 



to fail. The concept of an 




HBD system replaced the original mechanistic fi^raulktion, and some researchers 
so far as to say that MBO is a complete philosophy of management 

♦ s . * 

• (Altrrecht, .19.78) • 

, t \ - , Petfer Bfaicker , ' ix CThe, Practice of Management (1954), proposed a prin- 

' ' *'> \ • * • ^ 

ciple of management for business enterprise to harmonize the goals of the 

for fl 4 1 *t#M&*l output. This was presented • 
of resets accountability as opposed to the emphasis on the > human 
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. relations approach dominant at the time. However, although Drucker had 

Implied a philosophy of management, the rigid or careless applicability of 

# * * * 

* this principle without regard to- human resource factors, or incomplete im- 
piemen tation in terms of evaluation (deficits, demonstrated the limitations 
of a mechanistic MBO., Numerotts criticisms and new suggestions have been 
offered* A system of MBO was deemed necessary — a way to incorporate MBO 
into the conceptual framework of organizations as open systems- of the • 

■ total system, so that the objectifies are~~a~coordination of -the goals of all 
^-£he- other subsystems in light of the organization's main goals. Since the 
task is to quantify these objectives,- these results could be considered as 

. dependent variables (or* functions) ^f the parameters (systems) of the organi- 
zation. Of course, the problem lies In the delineation of parameters , for the 

more tenuous constructs, such as job satisfaction and the need t6 recognize 

urn- 

human relations factors in any MBO formulation. In theory, however, an MBO 
system should maximize the efficiency of the organization by not only the 
increased incremental sum of the achieved goals, but by the interaction of 
the entire system as well, creating a set of proven -methods which together 
mafce a total and comprehensive management system to improve company and 
.mahager„ performance (Humble, 1973). System approaches toward the iiplemen- 
^tation of MBO have increased their attention to parameters such as. job , 

• * "9 * 

satisfaction and other human relations factors in the recognition of the 
**** ? or * cooperative thrust at the subordinate employee level. Research 
* n '*^ ar * a attempts to quantify these more abstract constructs with more 
' a^wurable effects* Systems approaches are the most .prevalent interpreation 
in t&e repent literature,, in which" the MBO system, functions 4s an organic 
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. . . topi to be properly^ inter faced: "when the various aspects are integrated 

with a balance between the individual and organization needs, ... you have 

' organizational effectiveness and results'* (Beck, 1976) . 

Those who view MBO as a philosophy tend to subsume the previous * 

u a PP5 oachea: 1x1 the formulation of an fiBO attitude- to be conveyed to subordin- 

ates by the manager in a holistic way.. Karl Albrecht describes this phiio- 

v 

sophy in his Successful Management by Objectives (Albrecht, 1978) as a basic • \ 

■* 

. * mentality of managing and that when mistaken for a system or. a set of pr±n- • 

. ciples, a "rigor mortis" mentality can develop which will destroy the adap- 
\ • 
tive features of efficient management by allowing the responsibility of * * 

management to slip. into the '*me'chanism" or .system. In other words, Albrecht ' 

' > • * i ' * 

believes that when MB.O. is taken to be a. "system" by which to' manage effec- 
tively, the possibility of inappropriate initial Installment: and failure to 
acc'onnodate changes in the organizational environment can obscure the -effec- • 
tiveness of management. Critical to Albrecht T s formulation, the MBO philo- 
sophy consists of: (1) an objective-oriented manager whose "systems" under-~ 
standing conforms to the organizational goals and guides subordinates; (2) 
the need to instill the .appropriate objectives orientation to the workers 
• (with a full understanding ofVhat MBO is trying to achieve); and (3) the 
. implementation of the above principles in a reward-centered environment . 

* / . • * * ' 

MBO, like the rational-goal model, specif ies ^the primary criteria , of ' 

effectiveness by checktng-wfaether or not the organization has accomplished ~ ™ 

-'■ ■ ' ' * *' * ' " t 

its specific goals, and thus fits closely under the^oal-priented operation- 

f^t alization of organizational, effectiveness. MBO, as stated by Campbell et — * 

» al.-«Cl974), rather' than evaluating the' organization' on' some single abstract '* 

. .••'*. u* • • ' » ■ - '• 
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continuum such as the cost/benefit ratio, states that effectiveness is some » 

aggregation of specific, concrete, observable and quantifiable accomplish- 

ments or failures. Therefore, organizational effectiveness" can be approached 

, through. -a review of MBO studies on performance evaluation, and in terms of 

school evaluation, by focusing on MBO in the public sector, .and where MBO or 

facsimiles already have been established in school • systems (e.g., Dyer, 1970; . 
j - ' ' ' . * 

•Gray & Burns, 1979; Herman, 1978; Lasher, 1979; Malsam, 1979) J 

Management-by-Objectives implies a planning function as ^represented by 

.... .0 

the need to quantify what must be done (after careful analysis of .why it 
must be done, from the' organization's long-term and shoftrterm goals), the 
^pecification-of~the , necessary degree~of~detail as^to how it must be done, ■ 
the coordination of activities embraced by the process mandates assigning 
the time, these tasks are -to be done, and finally,' the need for accountability 
suggesting a weighing of "costs of the "system versus/ the benefits. 

Management-by-Objectives ^also implies a controlling function in the A 
sense that it provides a method for determining how well the prepared objec- . * 
tives are being, performed* how effective the completed activities are la 
realizing the organizational goals, and the necessary corrective action 7 for 
is^anng performance or dealing with unexpected situations. < 

Jones (1977) qonsidefced the problem of accountability in education 
thrbugh an MBO procedure for guidance and counseling programs.- .The five 

^motttA^tudy^involyed^32 counselors and 572 Students in, a Northwestern 
Cfclcagb high school district Including five high schools. An MBO technique 
for the test -group of counselors, and. a traditional *grot$ and 

^cmtroi ^oup (whose members .believed they had an "instinctive" flair for 



\ 
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answering student needs) were' Included. Reactive data indicated support for 
MBp but no ''hardJ'rcriterlta were used in the assessment . 

. A similar study of guidance programs in Maine by Vanzandt (1977) In- 
corpora ted the use of a special scale developed to quantitatively measure 
the quality of the program's services. The scale was. designed for th^ee' 
•student groups and a teacher .evaluation group by means of a Libert 5-point 
scale rating both the programs and services, and the counselors' personal/ 
professional skills. The study was an intervention design where an MBO 
program was implemented after a baseline ,had been established, and feedback 
concerning the "treatment" during the course of the study was .a critical * , 
' element of Vanzandt* s MBO model* . 

^. 8 !?^ *!^^ sixth, eight, eleventh, and Jtwelith 

) 

grades and all teachers were included In the administration of the Guidance 
Service Rating Scale and a needs assessment scale to provide the information 
a *?2£ t 64011 of four spool's guidance needs. Steering committees composed of 
students, teachers, administrators, and counselors used the information to 
determine the priority concerns of guidance, /then established criterion- 
referenced, v behavioral objectives to direct the guidance programs toward the 
priority no^u Time phasing and strategies focusing on counselor-otiutcomes 
were incorporated to emphasize the' intervention strategy and constrain the 
'interpretation of the results. Communication about evaluation results and 
.decision-making. were stressed as Integral elements of the MBO model. Un- 
fortunately, due. .to -the limited&time that could be devoted to the project, 
the . results were more a reflection' of the process, of using the MBO model 4 
than* an evaluation of the effectiveness of J MBO. •* 
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; Although the problems with this design are the consideration of extran- 
eous variables and the reliability /validity of the rating scale, the scale 
did find significant differences (p < .g5) in terms of the evaluations made 
by the students and teachers from the* Guidance Service Rating Scale. The 
author concluded that MBO may have a place in these 1 * xerograms for its practi- 
cality in helping guidance programs establish accountability. — ■ 
( 4 ln a s sttiiy involving university faculty , Shetty and Carlisle (1974a', 
1974b) .found that their MBO program increased the awapeness and specificity 
of gdals for participants, improved career planning and professional develop- 
ment, and led to overall improvements in planning. Additionally, supervi- 
sors in the study* indicated^that the MI^) program l^d, to increased objectivity 
in performance appraisal. Perhaps most important was the finding that MBO 
led to "significant 11 increases in individual performance. t On the negative 

side, participants indicated a substantial increase in "unnecessary paper- V ' 

t * ■ 

work. 11 Unfortunately, the' authors measured the effectiveness of the program 

with a post-imple men tatioji measure only, used no control group, and measured 

• all variables with ratitig scales. Similar results were"obtained by Smith . 

(1975) la work with stiff members of three universities. Two- other studies 

' 4 V '< / • • ' - . - 

-(Lasher,- 1979? Harsh, ft.979) report positive results with foBO^in academic 

;" ' ' • * * ' 

settings but present no data to support their positions., in a study involving 

junior college administrators, Roasano (1975) found better supervisor/ sub- 

ordinate/ relations "subsequent to the implementation of MBO btit no difference 

in performance levels. \ 

;^ Applications of MBO at the elementary or secondary education level have 



been. <iu±^e ^ limited. Altergott (1970) collected interview data for high Jfchool 
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teachers Involved in an MBO . program.' Participants indicated that MBO en- 
couraged more specific program planning, improved' subordinate/superior re- 
lations,' •Increased'subordinate participation in goal setting and" perceived 
subordinate authority. Finally, participants indicated a higher level of 
motivation under the MBO' programs . Altergott (1970) coaciSd^"that MBO is 
an. excellent approach to management for education. However, his' study was 
methodologically weak in thai no control groups were used, no statistical 
• tests were made, no objective data. were used as criteria, and only -post- 
implementation interviews were conducted. In a study to assess attitudes of 
participants toward MBO for appraisal- purposes, Eads (1974) found elementary 

, . . ' ■ » 

and secondary teachers expressed a. more positive* attitude toward a "super-, 
vision by objectives" program for evaluation than* several other more subjec- 
tive approaches. Principals^ also indicated a stronger preference ' for the 

MBO .approach to appraisal. The study was one of the more methodologically 

*' . v. 

rigorous designed to assess the "effects of MBO.- A longitudinal- design", was 
used with pre-test and post-te^t data, -and results were compared to. results' 
from a "comparison group. ^ -. • * 

Herman*(1978) and Malsam (1979) present case studies of MBO implementa- . . 
tions in school districts. While no data were reported, Herman (1978) stated 
that Objectives were successfully met with, the program. Several of the ob- 
jectives* were concerned .with cognitive achievement factors, such as: to 
de ««?» e a minimum: of 3 percehe the percentage of student^ reading below 
grade v level in the middle school,* grades 6 through 8; and . to .cause a gain of 
at'ieast one month beyond the no^Bal reading pattern established by the 
pupiis^who' remain below* grade level' within the time period" September 1, 1977- 



* 
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Ju^30,. 1978 *(p. 89). • '* 

McLagan (1980) in studying a special education center o found benefits 
in the MBO approach* to defining measurable goals and specific, identifiable- — 
behavioxjs. f # • - » 

AIMn and Schoderbeck (1976) presented their evaluation of MBO in the 
.public septo^J^" listing the constraints found in this setting and offering, 
thfee suggestions critical in the Implementation of MBO. \ The suggestions. > * 
werar^Xl) to begin with the initial formulation of clear strategic 'and 
operation objectives.; (2) to determine ^he appropriate evaluational criteria; 
and (3) to establish and develop an information gathering capability. \" 

The .researchers say that while in private organizations the formulation 
of strategic goals is more of degree~than a question of* kind, in public or- 
ganizations the strategic goals have never been stated adequately. They * 
cite the results of the Senate Committee on Governmental Operations in des- 
cribing seven major progradi areas and an administrative support area reflecting 
the nded'ifco define "key-result" ateas for ^uccessful MffO. .To fulfil^ 'these 
strategic objectives, another tactical level is required, 'which includes 
the short-run activities. At this point, the planners must develop a con- 
gruency between these levels. ) , 

, Once this has been achieved, the criteria *to evaluate the execution of 
these goals must be developed, and while goal attainment should be concerned 
with costs, quality is an important consideration as well. The Researchers 
also related a number of requirements for criteria they felt necessary (e.g., 
definition of target, area; of coverage, clientele. penetration levels, economic 
restraints, time dimensions, estimation of major 'consequendes., and a focus on 
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'the specification of the types and quality of services) . Unfortunately, the 

\ • . ° , - . «"« ^ 

authors did not specifically state any suggestions for the quantifiability 

of these factors, but merely tried t0' identify the range^and scope of these 
Items of consideration.' ~ • f " * ° * 

Aplin and Schoderbeck. collected information from public administrators 
employed by a, state. agiaacy-bavijig over 7000 employees, and found a number of 
factors critical for successful MBO application within* a public org ani zation; 
1) influence- in goal setting; 2) relevancy of feedback; 3) top level goal, 

setting; and 4) organizai^Qnal support of MBO. - s 

* * - . » 

The. study suggests t$at the first consideration, t&e' goal-setting pro- 

cedures, proved most effective when the subordinates contributed equally as 

much/ planning as' their superiors, and least effective when they perceived „. 

themselves to contribute more planning than their superiors. * The data taken 



from the surveys showed 532 of the respondents depicting' this situation with 

• * -53^ - >' * - * ■ «* ' 

only 19Z reporting the optimum situation. % The researchers suggest that. in 

the public sector, .thereby be a^ tendency, for a "too. much" degree of - 



freedom 



» v - ■ &® 

in establishing objectives — a tendency for an overly liberal - > 



of freedom in allowing subordinated to establish objectives which 
will negatively influence these- subordinate's perception of their roles* 

■ Hftlevancf of feedback was another factor seen as* critical for successful* 
MBO.. Although; much literature 'on feedback had^already been, collected, the 
esearchers point' out that relevancy \o£ feedback ,will induce more positive 
attitudes, ^greater managerial efficiency, enhance tl\e goal-setting process, 
and, inlpineral, generate? more MBO- support and effectiveness* 
s . ■/" Another factor considered by Aplin ,and Schoderbeck was top level goal- 
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setting. They noticed a previous 4 absence in the 'formulation of objectives 
.at the top administrative level, /and impairment to the resulting MBO program, 
in these, particular "organizations #*"' . 

The «f ourth/consideration .in' successful MBO implementation was the organi- 
sational support of the program./ The researchers point out that the interest 
of the. administration must carry-over to their subordinates, and specifically, - 
the survey shows that the subordinate managers mirror' the interests ' of "their 
"superiors. * ' * . . 

Aplih^and Schoderbecfc also delineate some constraints on* the use of MBO 
that have special significance for feducatibnal. systems. First, they state - 
there is reluctance on the part of public administrators to rely on objective . 
. data for evaluative purposes. A ^similar- skepticism has been documented for . 
principals when considering the use of achievement t^t data to evaluate — 
teachers. (Austin, 1^79; Davis & Gross-Davis, 197$. Such a reluctance stands ' 
;: as a barrier to the widespread acceptance to MBO among educators. Principals, 
r for example,, may feel that they have acquired a special capacity to subjec- 
' tively evaluate, their teachers, and that, an objective' procedure such as MBO 
'will interfere with what they consider to be tneir .uniquely^ appropriate 
appraisal method. Another factor'- that resists tne fulljimplementation of 

: */MBO is the reluctance of . administration to reward 1 differential levels of 

■ • i • . • • * ' *' 

teaching performance. The use of merit pay of any kind in elementary and 
secondary education has been rare*with results equivocal (e.g., ETS, 1971). 
Additionally, educational systems. are often controlled by political configu- 
''■,.?* tio ?* ***** may t undermine the actual control exercised by principals. Such 

i '*' ' ' * ' ' ' l * ' * ¥ * 

v * situation will, in turn, induce a reduced obligation toward compliance with 
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the MBO strategy. Finally, Aplin and Schoderbeck (1976) point out that 

today a changing environment demands mare flexibility and innovation in the 

public ..sec tor than the private sector to deal with the changes in morality, 

politics,^ legislation, and technology;. It is difficult to discern how such 

flexibility would affect objective criteria such as scholastic achievement 

and thus, MBO programs established with goals related to achievement. 

Luthan (1976). has suggested that MBO shortcomings in the public sector 

are** function of the misapplication of the system?with the different demands 

y * • ' • v 

of service organizations. He proposes a contingency 'approach to management 

^where functional if-then relationships between the environment (b^th internal 

and external) and management concepts, and techniques that lead to effective 

goal attainment are determined. He m aintains that MBO, as any other manage- 

ment concept or technique, cannot be' universally, applied to all situations. 

1 

because of environmental' differences. The identification of these environ- 
mental variables is thus necessary -in order to implement MBO in the appropriat 
fashion. Luthan then suggests examining the popular constraints as a starting 
-point, includingr >l) tfie preponderance of pre-set rules, laws, and regula- 
tions; 2) less opportunities to participate in setting objectives* 3) the 
emphasis on seniority versus merit; and 4) the lack of adequate performance 
measures. 'He states that «these factors are more often used as excuses for 
poor management, rather than impassible barriers to effective management. 

While .Luthan' feels that the most, urgent task is the identification of 
|hes^ variables, he -presents^ no solutions or .suggestions in light of his 
contingency management approach. . Luthan says this type of examination must " 
cov$r*fuch factors aVthe nature of objectives and political (educational) 
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environments* high levels of turnover for public organizations, and the A 

* -* 
rapid change in policies inherent in these organizations." 

Before an organization Implements an MBO system there are some basic 
questions wMch ^t be^answered : 1) what groups- or individuals-set t^k 
.goals for a particular organization; 2) to what extent 'is it realistically 

possible to define quantifiable goals for an organization; 3) how should 
s relative Importance of each goal be judged; '4) to what extent' is it 
possible to know'whether an objective has been accomplished; and 5) is the 
organization willing to commit the* necessary time and effort to the MBO ' 
procedure? ' ~* 

There appears, however, to be an even more basic issue to be raised 
in considering MBO as a model of organizational effectiveness.- Odiorrie ~ " , 
(1965) views the system of management-by-objectives* as a process whereby ' 
- tbe superior and subordinate (or in this case, the administrator and princi- — 
pal or the principal and teacher) jointly identify goals, define individual J 
major-areasHrf -responsibility^ terms of results expected of him/her, and 
use these measures as guides for operating the unit and assessing the con- 
tribution of each of its members, ^his definition, according to-Albauese 
- (1975) , brings.-out* two ideas basic to" most" applications 'of MBO. First, MBO 
implies ah interaction between managers and their subordinates in goal set- 
ting. A second basic idea of MBO is appraisal" of actual performance against J 
the- agreed-upon goals in "the^goal setting phase. . 

There is an argument that the objective -of MBO is to help tie individual 
teacher be successful because as the teacher- succeeds, so does the principal, 
*n^tn« school, and so on. While the organizational literature cites the ^ 
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benefits of goal setting for individual performance "(Latham & Yukl, 1975), 
successful. completion of individual teacher goals or objectives, however, J 
do not necessarily guarantee. a successful school system. To conclude that ' 
if a given teacher improves reading levels at the third grade by two months, 
automatically makes the school system, as a whole effective, is to imply that 
individualwacher goals can be chosen so as to totally represent the goals 
of the entire scho.ol system. This is certainly not the case. While an in- 
dividual teacher's goals- can be made compatible with the system's goals~they 
are not a substitute for them. All teachers in a school system may_ have 
attained their goals under an MBO system, but the school system itself may 
not. have reached its goals. For example, many teachers may have set and 
Reacted gPjas^concerning- such aspects of the job as planning, managing, and 
organizing instruction^ proviljing a favorable psychological environment * 
for learning, and increasing reading levels by two months. However, if the 
school system that year ran at a substantial financial deficit, it would be 
difficult to conclude that the school system was effective even though cer- 
tain individual teachers were effective. .The point*here is that the teachers' 



goals and^the .systems' goals may not be completely compatible, Molt of the 
applications of MBO to school systems have made little^attempt to adofet any 
type of "ca'scading process" in goal setting, that would foster a closer 
compatibility between goals across organizational, levels. Most of, the. 
"research has focused on "teacher or principal goal attainment, and hot the 
entire system (i.e., a district, county, or city system). 

i Coal Measurement. Even given a "total", organization-wide MBO program, 
the .pajor obstacle Ito MBO in the educational context is goal measurement 
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- (i.e., the "criterion problem") • # The typ^s of goals typically set by teachers 
. and/ or school systems lend themselves to be evaluated ±a one of two ways. 
.Goals are either evaluated by ratings (principal and/or student) or pupil 
gain scores on standardized achievement, tests. Both means of determining 
goal attaiwnfrfrave' problems wb^Lch shall be deait; with in turn'/ - 

A large number of studies have. been. conducted which /used standardized 



achievement test scores as the criterion to measure teacher effectiveness 
(e.g. Anderson, 1954; Brophy, 1973; Eb'el, 1973;' HeU & Washburne, 1962; . 
Wolfe, 1£77) . The educational literature has expressed mixed opinions as 
to 'the appropriateness of using such measures. Ebel (1973) defends the 
use of standardized tests as a basis for judging the effectiveness of a. 
"school system,, stating that the information provided by .these tests help 
school boards focus their attention on. the weaknesses of the school system, 
thus allowing more Hmmediafce and purposeful remedial action. Most of the 
empirical data, however, "would not support Ebel's position. Soar and Soar ^ 

(1977> f Brophy (1973), Hall (1964) and others argue against the use of 

. >* ■ \ 

"achievement test scores'. 

Standardized Test Scores as. Criteria . Airasian .(1979) states that 

standardized achievementftests have been criticized on three basic grounds; 

1)* those characteristics Intrinsic to the test, .because of what they are, or 

what they measure; 2) those characteristics not intrinsic to them, what they \ 

aren't or 4otf f t measure; and 3) on the basis of what they dd, their perceived 1 

effect on pupils, teachers, and the educative process in general. Airasian 

notes that those who argue that "it is a misuse of lieats to evaluate teachers 1 

• f . * . \ 4 » - 

performance on the basis ^f their pupil's standardized achievement test 
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performance have done so by mentioning all of the characteristics cited 

above.- For example, typical comments* voiced by those "kn opposition to the 

use of . standardized achievement tests are that such tests measure only a 

small sample of what 'teachers try to do (intrinsic. factor) /do n&^measure 

specific classroom goals (extrinsic factor) /and to use such tests in this 

manner will mean that" test content will dominate the classroom , curriculum. 

In reply to the criticism that standardized achievement tests do not 

match the-specific objectives of an instructional program Cronbach (1963) 

?< ••»*., ^ 

offers the following. An ideal evaluation would include measures of all 

t 7?„ °f T roflcienc y *"»t might reasonably be desired in the area of question, 
T»t just the selected outcomes to which the curriculum directs attention . 
"XT one wishes - to know how well a curriculum is serving the national interest 
one should measure all outcomes that are worth striving for. Standardized* 
achievement tests which sample a broader range are more likely.- to help 

■A « * i I 

. **> * 

answer the- question of the adequacy of a particular 'curriculum than are tests 

"tailor-gjade to the specific instructional objectives. While Cronbach' s point" 

regarding the usefulness .of standardized tests for^evaluating a curriculum 

i*^- h e does not speak- j» the "issue of, using such tests for the 
:'/-•» . ' • y 

'purpose <Jf evaluating teachers. A serious misuse of 'these tests occurs 

;V. " . ♦ . ; . > * 

>when a single achievement test score is 'used as the sole criterion in" an MBO ' 

-< or accountability program for making important personnel decisions. 
ir \ KH«ir*i97l) summarized the major problems of using standardized achieve- 
ment tests as criteria.as^follows; _1) questionable test ^taUdity; .2) p'ooru-- 

overlap between program and" test objectiVes; 3) inappropriate test instruc- 
'•• '.V . ' ' - • 

Jlon and directions; and 4) confounding designs and formats. Averch et si. - 
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(1972) add that such tests are too often misused or misinterpreted. Airasian 
(1979) reviews some of these misuses. In addition, when using standardized 
achievement tests^ effectiveness or goal measurement is ^typically accomplished 
by the use of gain scores. Gain scores, howevery^produce a very biased esti- 
mate of true gaiit (see for example, Harris, 1963; Nunnally, 1978). 

* * * 

The empirical evidence appears to support those opposing the use of 
standardized achievement tests as criteria of teacher effectiveness. 

Rosenshine (1970) attempted to ascertain the external validity of. 
student achievement scores as a measure of teaching effectiveness • He noted 
that in only one of the. nine studies reviewed was a correlation coefficient 
as high as r » .50 found while all the rest were at or below- r * .35. He 
conclude* that residual achievement gain scores cannot be used as measures 
of teaching success with any confidence. 

Shavelson and Ruaso^ ($75) review also questioned the ability of 

achievement tests to accurately assess teacher effectiveness. The authors 

note the consistent conclusions of previous research as to the "instability 

» 

.of teacher impact, on student outcomes" (p. 29)', *tohich may be attributable, 

t?o the instability of teacher behavior, an- area that has not been assessed 

in its. own right. They point to the problem of the lack of an operational 

'deflation of teacher effectiveness,, and to strengthen their_point, draw 
.•'.'•'*'"•"• - ' . " ' " • 

out .four qualitatively different definitions from past research*. Another 
" f' ' • . ' ■ / r 

problem they cite is the "collective display' of stability coefficients which 

vry tauyatematieally la »g^tqde w ^p. 177). They examined the studies in ' 
the context of the three dimensions, of external validity as proposed by Snow 
.(1974), and not 6Spof those studies met. the criteria on any one of those 
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three facets. The authors concluded that the instability of the data "makes 
generalizability in an educational context tenuous" (p. 38) and also recomended 
against the use of student achievement scores >a^tuea^ures of teacher effective- 



ness. ** 



4 Brophy* (1973) attempted to observe teacher efficiency scores (as plotted 
graphically over a three-year time span) as^reaictors ofTfuture^uccess, as 
measured by pupil gain scores. He was able to observe 51% linear trends 
(linear .consistency, Improvement, or decline) from among the 145- teachers 
who taught at the same grade level for three or more years. . Because of the 
moderately low consistency found, Brophy also warned against dfi/"ixxdiscr±mii>- 

ant use of . student gain on general achievement testa f.or assessing teacher 

• , . , • , . „ 

accountability" (p. 252). % /» ' 

In a classic study, Barr et al. (1935). tested the validity of several 

measures of teaching effectiveness as measured by gains in pupil achievement-. 

Reported correlations between ■ the ninteen measures of teaching ability and 
1 < , > ' 1 - " 

- pupil achievement were "uniformally low and insignificant" (p. 137).. Inde- 

pendent variables included a composite of seven commonly used rating scales, 

a composite of six tests of teaching ability/ and ^composite of aH 19 

variables. The inconsistent datat also failed to indicate a preference be*- 

. tween the several measures of efficiency, or to validate any of those "com- 

» monly-used". teacher rating scales. The authors concluded \ that ^either the 

<* . * fc -. * ' v * • 

' ixwtruaents chosen* we?e externally invalid gr/tfte^Stanford Achievement" Tests 

•were* inadequate as criteria for gains : in 4 j^^\<^±^emeat. - 
.* . * * 

Anderson (1954) correlated pupil, -supervisory, and self-ratings with 

man pupil gain scores. Using' a series of regression models using pre-tefct 
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scotes, squared pre-test scores , ^pupil sex, and teacher. effects variables, 
^he also attempted to predict pupil gain scores. The rating scales had no 
significant effects as was the case with the regression equations. Anderson" 

. • - ' i' 

concluded that*£he results did not yield sufficiently high cprrela^ons. ^o 
justify the use o£ residual gain scores as measures of "teaching, effectiveness. 

Soar and, Soar (1977} , in .their discussion of the problems Inherent in 
using test gain scores as criteria for teacher effectiveness, state that 
unless individualized background factors (I.Q., socio-economic background) 
are considered, the criterion li useless and invalid. They state that as' 
much* as 80Z of the ' variation in class averages on those tests is due ty^ f ac- 
„ tors- uncontrollable by the teacher. The authors state that differences exist 
in a teachers' success in instructing studeats on simple level items (requir- 

ing rote.memorizatiori only) and more complex items {requiring abstract 

• . - • * 

Jihinking), and that this_ distinction has yet to be the focus of research. • 

Chase (1974) observed that standardized' achievement tests measure a 

restricted sample of a child's educational. behavior,- and also tend to be over- 

. valued in the assessment of academic performance. The. tests, he claims, 

overstandardize the curriculum by identifying certain topics as more essential, 

which 'OMistri^ts v -indiyidual initiative and creativity of pupils and teachers. 

'.*;'.* - • •' ' ' ' ' f, ' 

He m aintain s ^ these variables are the key to pupil educational growth' and,.,.. .. 
\ -'v . k « ' ; . • ' ''•*.»' ' 

maturity^.. I^nkamp. (1977), notes -that when noncognitive * factors are, used, 

■ •■ * ' ; "' * ' .-'-»' .' • ' ■ • . • ■ . • 

they are used almost exclusively as, additional' predators of cognitive per- c 

formance.* The consistent finding however, that these noncognitiye' factors , 

■ ' * *' e * „ ■ ' •* < 

do 'not relate^ to cognitive performance has resulted in the premature conclu- 

'• '• " *' • '- v • • *'.**■ * ~~~ 

sion that their significance is limited. Ingenkamp states thhTnoncognitive 
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_ -factors such as reduction of school anxiety, the forming of relevant motive- } 

tion and interests, and education toward emotional stability! all constitute 

l « A- 

Important alms in education, whether they manifest themselves in the improve- 

. meat of cognitive performance or not. Another problem according to Chase 
(1974) with the tests themselves is the subtests, which the autho*-sees as 
having too few items to' hold up to minimum validity standards as well as 
they ; should, j* 

a Ic appears t£at the most "countable" results in terms of educator 
effectiveness are replete with problems of measurement and interpretation". - 
Empirical tests have for the most part not supported the use of achievement 

, test scores "as measure of teacher effectiveness.. Their continued use has 
^ten-attributed to the fact that they have face validity (Madaus, Airasian, 
and Kellaghan, 1980) and provide a "poUtically" attractive index on which ' 
to base accountability decisions (Airasian, 1979) . Ebel (1973) however, ' 
points out that many of the empirical studies have been methodologically 
flayed. At this point we'can only conclude that the uae_fif standardized , 
achievement scores In an MBO, as well as a rational-goal approach to school 
effectiveness, has great potential for problems of interpretation. , 

It has been suggested by Madaus et al. (1980) ^hat to be considered 
valid, outcome measures <Ln studies of school effectiveness must tap. achieve- 
ments, skills, processes, and learning that are specific to school ins.truc-. 

V t±Pari ^\ If the outc °° e measures used to assess school effectiveness are pri- 
marily surrogates for home background arid general ability, rather than 

• <f ' * - ? k • , * 

• 1 ? a . a * Ure? o£ ,s ch0 ; ol -3Pecific a chievement, Inferences about the differential ' 

* • ' 7, 

t effectiveness' of^h^s.^are invalid, since the measures tell us little 
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about what is taught in school's. To dealVith the relative insensitivify of 
standardized norm-referenced achievement tests for detecting school-specific 
pupil achievement, some have advocated- the use of criterion-referenced tests 
(Cronbach, '197irGlaser & Niko, 1971). It should.be noted at this point that . 
the same achievement test can be. crtterion-ref e^enced test or a norm-referenced 
test (Mehrens S'Ebel, 19T<^7 The distinctions refer only to the interpretation 
y\of the test, not the test itself or the way it is scored. A nor^i-referenced in- 
terpretation adds meaning tp a person's score by comparing it >o those of. other 
individuals in a-specif ied group, k criterion-referenced interpretation, on the 
. other hand, -adds , meanirfg to a person's "score by comparing it to some specified 
criterion of proficiency. This<*latter interpretation appears more compatible 
with the goals of accountability programs and seems more. appropriate for 
. measurement for use. in an MBO or rational-goal .approach.^ It should be noteld, 
however, that not everyone would agfee^ith this recommendation.^ Shepard *' ' 
(1980) states that the standards used as < cVLteria*for criterion-referenced tests 
are- arbitrary cutting points* along a continuous performance scale which im- 
pose an artificial dichotomy. -This dichotomy . serves to obscure performance 

- # 

Information about individuals along the" entire continuum. In' addition, 
since it is not possible, to" have- an* objective, non judgmental, standard set- ' 
, ting process j Shepard recommends • that standards not be used to interpret test 
data regarding the value of educational programs. However, by. its very 
nature, decisions regarding^effeptiveness must always contain a judgmental 
; component. The practitiione^is also'* reminded of the other limitations in 
the use of test scores for effectiveness decisions, particularly the use of 
ohe^ index as a sple criterion and the fact that the tests are typically not 
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measuring school-specific factors. While a strong case can b e made for the 
use of a criterion-referenced Interpretation as opposed tqU norm^refer^ced 
interpretation of standardized tests, the question still remains as to 
whether achievement test Scores are an appropriate measure of school systems 
effectiveness. The data, at this point, seem to indicslte that they are' not. - 

There is one final criticism of tests pertinent -to this discussion. 
While tests may distinguish between those* pupils who have learned something 
and those who have not, they provide no information . as td jiow or why the x * *• 
learning did or did noi- take place'. To assess the how 01? Why the most f re- s „ j 
quently used*form of teacher evaluation- is a rating done by^either the princiA ■ ' ' J 
pal or the students (e.g., Critenden &. Norr, 1975; Frey, Leonard-, & Beatty, ' ' ^ ' 
1975; McNeil & Popham," 1973; Scott, 1975; Watson, 1974)*. & witW achievement ' ^ 
test scores, however, there is little concensus in the .educational' literature ' 
regarding the appropriateness of their yseJ Scott (l*75)^and Watson f ( 1974) \ 
view student ratings of teachers as cons^utiag one ot tie* most credible", * %.-# v 
indicators of professional performance available, and view the information 
obtained from evaluations as being valuable and necessary* Watson (1974) in * * * " 

ctae study found, that at the high school level, teacher feedback from students 

^ * , , » »- *** ^ 

was more effective than feedback from supervisors in leading to* a positive % * 

• i . ♦ * 

change among teachers. This, supports another criticism of MBQ. " MB6 Was 

"WN ' . 

not originally /designed to be used as'a performance appraisal strategy*.. It' • - - 

* * . 

is best when used as an organizational development tool, the benefits of 

'which are supported by Watson's (1974) findings, » »' , j^, 

Although used frequently, many have questioned the validity and* *f air- 

ness of supervisory ratings of teachers as presently conducted* J[Criitenden & 
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Nortr, 1975; Marsh, 1979)^- Robinson (1978) notes that most evaluators (i.e., 
„ principals) have 'had no training in observational techniques. McNpil and 
Popham (1973) in^a review of the educational literature, criticized super-, 
visory *ratitigs as being unsatisfactory on several grounds, including the 
confusion of. a teacher's personality and staff relations with his/her" teaching 



ability. In addition, teacher ratings, like any other employee ratings, are 

5 * 

r , • * 

plagued by problems of halo, central ^tendency, leinency, etc. A thorough 
review of the errors associated with performance ratings is presented by 
Landyand Farr (1980). MBO typically calls for the measurement of countable, 
quantifiable result s, (e.g., achievement test scores) in order to avoid some 

^of -the problgns in human judgment. With ^this approach, however, there 'is 
the distinct' possibility that the more "process-oriented" variables, will be 

/ignored because they do not yield easily "countablV* results. Exclusive 



attention to ^end» results 1 ! such as student achievement while ignoring teacher 



behavior could <prove disastrous in terms of unmeasured, long range criteria , 
such as. student attitudes toward learning. While teacher ratings can serve 
as a^yehicle to rate teaser behaviors, they are typically not use4 as such. # 
This is disheartening in light of Rosenshine and Furst's (1971) findings > 

sed on reviewing 50 studies of" classroom instruction. These authors found' 
that grdwth in cognitive achievement appears to be promoted by 11 classes of 



teacher behavior (e.g., clarity of presentation, enthusiasm, avoidance of 
strpng negative criticisms) . In addition to- behavioral components, Hanushek' 
(1977) stresses the importance of teacher's personality characteristics as 
^they 1 relate' to student per fqjmance.. 

AaL'a practical matter, there are a number of problems inherent in goal * ' 
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Tebay (1973) stresses the importance^ employee participation in goal * * 
■-setting. The question, thus Arises as to whether individuals are truly, in- 
terested and/or .willing to participate in the goal ' setting process, and if 

* '. * 

they are, are they capable of such participation? According to Gray and'. 

. • ' \ 

Burns (1979) , a major reason why individual teachers are reluctant to 

participate in goal-setting, and why MBO doesn't work- in schools, is 

because, performance appraisals in school systems are not, tie< to the reward 

system in any way. Levinson.. (1970) rejects'thVmodel outright, by stating 

that since it is not tied to the reward system it will subvert its own 



intentions. Salary increases, advancement, and lay-offs occur as a func- 

- • . y - 

-.tion of collective bargaining and tenure. There are few, if any, penalties- 
for" .mediocre ;perf ormance . * ' 

^ -It woujld -certainiy be beneficial if? performance ..was tied to the reward 
system, particularly at the elementary school level where MBO appears to be 
most appropriate. Much like the ral§xfaal-goal model discussed earlier, MBO 

provides a gocrd framework within which to assess the effectiveness of *\ 
**■ — - \ v , 

teaching basic skills at the elementary school level. Goals^can be easily 

established (e.g., increase mathematical ability from a second to a third 

grade, level) that are compatible with all parties concerned, and their 4 "* 

- attainment eta be measured reasonably well by criterion-ref erenced interpre- 

*tations of -standardized achievement tests. . The next questW becomes, is 

goal measurement alone indicative of effectiveness? The missing component 

tha^ioul'd make MBO and the rational-goal' approach complete as models of ~ ' 

* r , a - 

school -system effectiveness, ► would be a concern with behaviors as well as 
outcomes* The functional model/presented next incorporates this missing ' 
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component* # . ^ , 

The Functional Model < • V' * . ' 

7 ' " * 

'This model, as delineated by Cunningham (1977), staS?that effective- 
ness Is- determined by the social "consequences ojE an organization's activities. 

• The crucial question v i?: how well do the activities *j>i thesorganizatiou 
benefit its. client groups? In terms of school systems these groups may be 
parents, students, taxpayers, other schools, .etc. The organization sets ~" 
certain goals and seeks, to attain 'them through satisf actic^f ' the client' 
groups. These goals should be precisely defined, and the activities^ecess*- 
ary for their accomplishment, should be delineated. Appraisal of organiza- 
tional effectiveness cons|dirs_whether_ these .activities are functional or • 

■ . 1 ' ■ . , / \ 

' <^*"8^*0B^l.«dte achievjtng it's s gpais. Unlike the other approaches there ■ 

* - 4 ;■ * i .'" •'•»"■ .. . . 
is fn emphasis on "means" in addition to "ends" 



£?' •'4 :? W^* i,ca ^ on ?^i ,eve ^ is functional-dysfunctional.' dimen- 

sion applieCbnly^t^fchp Organization '(i.e., the activities 'are only assessed • 
In relation, to, the ro^ga^^atioj&i^notVe client groups).-. Thus, the organiza-- 
.tioitt s activities would^Je.. asse^ed ^fe . good' of bad only in- regard, to their T 
ttfe'ct on the- organization its&'f lf/<fc&rally, effects of tlfese activities- ' 

oh relevant client groups are %oto considered. ' This seems to be a fatal '•flaw 

• ■ * v • . *?; H'l/ -* > 

in a-thedry whose frame of reference -$ar£he- external society. 

• ,•• . • ' ' 1. '-'' I fi" ■ - 

- Michael and Metfessel (I967) v present 1 : a model of educational evaluation , 

tHat'i* Wry compatible with- the .functional* perspective." Their- model attempts 

* * " ' * - • : I " '' ' , "- . 
to account for. the effects of organizational activities on relevant groups 

external to the immediate organization. .rTheir model calls for: the 

of programs involving members- ofjfhe total" sfhool community such 
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..as lay individuals and groups, professional personnel, students and student 
groups; J2) the construction of a hierarchical list, beginning with general 
goals and going to specific objectives which are operationally defined that 
allow relatively objective measurements whenever possible; (3) a translation 
of the i specific ; behavioral oh [jective'santo* a form that is communicable and 
applicable; (4) the development of criterion measures which reflect program 
effectiveness in terms of the objectives;' (5) the periodic use of these 
measures to assess behavioral changes. consistent with the objectives; (6) * 
the analysis of data generated 1>y' these ' measures with appropriate statistical 
methods; (7) the* interpretation of these, data in terms of certain judgmental * 
standards to ^derive Information abouf^the direction of ■ growth, students' 

progress, and the effectiveness of. the total program; and (8) recommenda- . 

. v ' ■ ? * ' 

tions which are based upon repeated cycles of the evaluation process and 
which provide further Implementation; and modification of the broad goals 
and specific objectives. > « " ~ 

• * 

^ The authors also present multiple criterion 'measures for the evaluation 
of school programs, such as: (1) indicators of status Or change in cognitive 
'and affective behaviors of. students using standardized Instruments such as 
achievement tests, self-inventories, etc.; (2) indicators, of status or change 
in cognitive and affective behaviors of students -using informal or semiformal 
teacher-made instruments such as incomplete sentence'techniques, interviews, 
peer nominations, etc.;. (3) indicators of status; or-change in student behavior 
using means -other than the- above such as absenteeism, attendance, . anecdotal ; 
records, etc.; (4) indicators of status of change in" cognitive and affective 
behaviors of teachers and other school personnel such as attendance, published 
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articles, elective offices, etc.; and (5) Indicators of community behaviors 
such as alumni participation, attendance at special school events, parent* 
teacher conferences, etc. With this paradigm, more . consideration is given 
to "means" .(i.e^, behavioral measures) than .with other goal-oriented approaches 
(e.g.-, Cunningham, 1977). However, as with other, goal-oriented approaches 
the problems of goal measurement still exist and -are not discu*sed by Michael 
and Metfessel. (1967). s ' \ 

Goal Attainment Sca ling : Goal attainment scaling (GAS) is another** 

popular goal-oriented approach £hat fits within the functional model of 

« ') 
organizational effectiveness. Introduced by Kiresuk and Sherman '(1968) , 

GAS is a technique designed principally to assess individualized goals in 
specialized programs. There have been several applications of GAS to the - 
educational domain^Cytrynbaum, Ginath, Birdwell, & Brandt, 1979) with con-, 
centrat^on on programs in spec/al education. Kiresuk and Sherman (1968) 
list the major prescriptions for GAS as: (1) change goals must be set 
Independently of. the process (goal setter arid deliverer should be indepen- 
dent); (2) clients should be randomly assigned to .treatment conditions ; ; and 
(3) the assessment of goal attainment should abe done, by Independent raters. 
Cytrynbaum et al« (1979) note that most of the studies evaluating applica- 
tions- of GAS for school prog^ThaVe ' deviated from these essential require- 
ments (see also. Calsyn, Tornatzky, & Dittmar, 1977). Cytrynbaum et al. 
(1979) conclude that the popularity of GAS is unjustified given their thorough 
scrutiny of results. /The authors recommend further research* directed at a 
clarification of critical arid influential parameters affecting the GAS 
approach. ; It should also be pointed' out thit Cytrynbaum et al.' cite 
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methodological' and design factors 6 that preclude definitive conclusions ' 
regarding GAS. 

jpreaont (1975) presents an*'excelient discussion of the appropriateness 
of the functional model for public organizations. According to his analysis, 
the major featured of the functional model are: (1) goal attainment;' (2} 
adaptation; (3) integration; and (4) "pattern maintenance. Regarding the 
first 'feature, (Jiimxingham"(1977) and others discuss goal attainment in terms 
of a set* of specific output values that are important for*ke? client groups. 
The "adaptation" function deals with a det&rminatibn of resou^es that are 
necessary to achieve the stated goals. Problems such as conflicting goals 
of client groups (i.e., t^payersV parents » students! and measurement issues 
regarding goal attainment (Averch et al., 1972; Hanushek,. 1977), however, f 
.may attenuate ^the appropriateness of the model for school effectiveness. 
The "adaptive" aspects of goal attainment suchTas resource procurement, 
Management, and budgeting also represent conflicts' between client groups 
and organizational members (e\g., teachers). The "patfcerii maintenance" 
funcj^on^tnvolves a reduction in conflicts, across client groups and within 
thejorganization (e.g., increasing teacher job satisfaction). This *func- 
tion, however, id only considered as a "means" toward goal attainment. • 
Thus,-giveri^conflicting "client" goals, even "patter maintenance" functions • 
will engender .conflicts across client groups and within the organization. 
The lack of empirical support to- justify* "pattern maintenance" functions for 

goal attainment (e.g., Better facilities will result in higher pupil achieve- 

• . • * • • . ■ - s . ^ 

»ent j higher teacher pay will result in higher pupil achievement and higher 

non-cognitive^ skills) predicts constant strains for the integrative aspects 
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of the organization's functions and in it's relationships with client groups. 

One of the major shortcomings of the ftmctiona^fodel as it has typically 

been applied to school system* is Its -preoccupation with "end-states" and its 

consideration of "adaptative" and "pattern maintenance" functions only as 

-j ' " • ' 

"means'-' toward- the "end-states." The functional model is not concerned with 

o 

"means" in and of themselves, rather it emphasizes "ends". The functional 
model then, in practice, is equivalent to an MBO or. rational goal approach. V~ 
Thus problem^ of goal articulation and goal measurement that beset other 
goal-oriented apj^oaches also affect the efficacy of the functional model 
for educational systems. 

A major criticism of the function^ model is discussed by Perrow^l4^a) 
who questioned the unidirectionality of the approach as conceptualized by 
Parsons* (1960Wnd v others.* It is the nature 'of static-research, he states, j 
that implies the organization's activities affect ita client groups and not i 
vice versa. In the educational context, not onSLy dd^§ the unidirectionality 
assumption make little, theoretical sens* but t#ere is faiJtty strong empirica 

, 4, ' ' ' - X , 

support to refute it /as well {e.g., Avetch et al., 19.7^f HAushek,^1977) . 

At a conceptual level the functional model appears to Contain all < 
the necessary dejjgonents of a pomplete^ffectiveness model.- .Unlike- th 
rafctonal-goal model and"MB0, it incorporates botlpTends" and "means". The 
functional model is concerned with the effect of a school system's activities 
on its client groups. Unfortunately, ^he model as c&sdusse^by Cunningham 
(1977>, has not b^en applied to school systems. Where^e -model has been ' v ' 
attempted, it typically concentrates on "ends" 4 'at the expense* of\ investigating 
"Beans". While appropriate at a theoretical level, ' practitioners .should be^. 
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aware that in applying the functional model to school systems, they must' 
contend" with the 'problems bf goal-approaches (e.g.., goal measurement) plus 
**** ***** d±fflctfL ^' of »*«n»log behavior (e.g»., which behavior should be 
measure^?. >4 how * «'*hd by^jhom?)^ Given the difficulties' involved in the 
flatter 'it is not surprising that most applications of the functional model ■ 
have focused, exclusively on outcomes in lieu of teacher behaviors. 

•Thus',- f or 'thejjr^efeitioner concerned with assessing^ the effectiveness 
of a schodl system, the functional model offers the optimal solution focusing, 
on outcomes and behaviors.- The application of this approach to an ongoing 

< - ' ' 

school system, however, would be difficult 'and time consuming/ It would » 

- •* 
be time consuming in. the sense that • someone; be it fellow teachers or prin- 

s • . 

cipals, would need to take the time to observe teachers so they could eval- 

:" ' * . • . > 

uate theit behavior. It would be difficult, in the sense that (1) a 
teacher's activities are not easily meaWed pr evaluated "and (2) "different 
• teaching styles may yield siadlar results. Who is to say whdt method of""' 
'teaching is correct? The greatest difficult', however, is that ideally prac- • 
t^tioners would like to relate these observed behaviors to objective outcome 
measures, which brings .us full circle,, back to thtt^roblem of .validity^ for 
standardized teistfcjfeitlx has, already "been discussed. — — — — , 
The Cost-Benefit Model •'>''. ■ 

• - t P> 

- Cost-benefit models have generally been directed at the evaluation of 

m' ■ * * 

the relative effectiveness of different 'training programs. Such an evalua-- 

tion is most often conducted in a goal-centered framework (e.g., Rivlin, , 

1971) and thus addresses , the question as to whether an organization is * 

accomplishing its goals with procedures that ar^ cost-effective relative , * 
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to other prdcedures (cf., Wolfe, 1977). The model Implies that there are 
alternative courses of action available to the organizatiori, and that they 
can be compared. .This is not usually the case. Efficiency is the central • 
variable In the cost-benefit model as with the systems-resource model (tp be 
discussed la the next section). Therefore, the general problem with' measures 
of this construct addressed, in the context of the systems model applies' to 
cost-benefit models as well (e.g., Fincher, 1972). 

Simply stated, the goal of the cost-benefit model is to optimize «the 
ratio oncosts to benefits - There are two assumptions implicit in .cost- 
benefit models: (1) that the components of both the numerator and denpmina- 
tor can be empirically,. Intuitively, or rationally reduced to 'single ccmposit 
scores; and (2) that the resultant composite scores have intervajt scale 
properties (Campbell et al., 1974).* Both of these assumptions, have been 
questioned^ particularly in applications i; to school systems (Hatry, 1970; 
Rivlin, 1971). Additionally, this model necessitates' the use of outcome 
variables that' are more distant and less under control of the organization 
being sttflied^ (Campbell et al.,-:. 1974) . r 

Thejnajor advantage of the' cost-benefit model as applied to school 
systems is that it ptty9i^&^r^^ji^^-frl^^Qx]^£oT evaluating varidu> — ~ 
educational strategies. . Research has been directed at refining measurement \ 
strategies-.for'both inputs and outputs (cf., Chase, 1968; (aennan,' 1972; 
Mangum, 1967). * 

Fansel and Bush (1970) provide an excellent example of a cost-benefit 

% • - • • ' 

model applied to^social system; specifically, a health care system. They 
also present a method for converting ordinal data to interval data., In their 
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study, effectiveness was defined as the degree .of function or dysfunction 
la- the affected populations This continuum was defined in te,rms of a per- 
.'son's ability to caruy on his/her daily activities. Using, the paired com- 

♦ » \ * " 

parisons scaling technique, subject matter experts derived interval scales 

" . ..* • ' • 

. .from judgments of the ordinal descriptions. The authors presented some -data 

•» . - ' * < • ■ 

on. a tuberculosis control program to illustrate cost-benefit analysis. 

As applied to .the' educational Context; Hatry (1970) maintains that cost- 

- benefit ^analysts do-not-constder gaals-orobjecfctves with?; an^peh^systems 



perspective. Thus,, constituencies who may be directly affected by decisions 

-from cost-benefit analysis may have little ^or no input into the .setting of , 

operative goals on which the cost analysis is 'based. Furthermore', he also 

questions the overemphasis -onmeasures of efficiency to the- detriment of 

measures of effectiveness. The majority * of , cost-benefit studies use pure 
- / ' - " - ^' • ' ' ' 1 . .- - ■ • ■ " 

cost measures .suclr. as 'expenditures per pupil" .(e.g. ,iaw, 1977). Other 

. " • f - h :> , 

studies^ have used workload measures such- as, number of ^"teachers, per pupil, or 
physical standards (students p*er square foot or per^classroom) . Airasian 
et.al. (1979) refer to these 'as static variables, and note^/that while they * 
are» easier to. manipulate* 9 such pro^y .measures are only indirectly (if at 
all) related to^measures of effectiveness. A smaller group of studies have : 
attempted to develop ^composites, to several measures uSing a common metric- • 

• » • 

sucfc as doUars. Hatry'(1970) classifies such .measures as "hocusr-pccus" 

in that they conceal the value. judgments made by the analysts.. Rivlin (1971), 

Hatry C1970), and Campbell et al. (1974) .recommend A multiple criterion . , 
. [- ^» . i ■ . * * 

approach to effectiveness whereby all relevant . constituencies (see Connally, 

Conion, Su Deutsche, 1980)^ assist in the specification of' unambiguous objectives 
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and methods of assessing -their attainment. • Such criterion should not be made 
equivalent using "bogus" dollar figures simply for theFsake of forming a com- 
posite criterion.. f * * 

Wolfe (1977)" provides an" example of a cost-benefit approach that incor- 
porates an operatdonalizatiou of effectiveness that is more closely linked 
to the general objectives of, educational systems. He stages thatliis pro- 
duction function approach csin help schopl policy-makers uJake rational deci- 

* * » / 

- * . • • * n r « * / 

sions involving: — (-1)- defining -the goal(s)'^>f the system; (i) collectins? — 

. o no 



data relevant to each pupil; and (3) analyzing the information in a System- 
atic way that relates inputs" to* defined goals of output. 

Wolfe studied a large urban school system over three years ,to determin^ 
input-outputs relations for grades three-six. The major questions\f ' his study 
were: what school and teacher characteristics will maximize pupil achieve- 
*ment growth, and, combining school* and- teachers cEaracteristica, what' are the 
most effective inputs per dollar* Tlxe Independent variables used in, the—~ 
study were: Teacher .experience; National Teacher Exam score; school ,size 
. (enrollment), class -size; library books per pupil;? rating of teacher's 
. undergraduate instructor ^bucational level of tetter; and school charac- 
— teriatica ( i. eV >7 play^eoaad-fo%ta ge » . dat e bu^ t-r^adition^of-gchool) ; 
The dependent variable was student gain scores on. the Iowa- Test of , Basic 
Skills (grades, three-six). The production 'function used in his analysis was: ' 
oA- fCTjTj -6SES, T 2 , T £ »6SES,..., Sj'.-Sj, ^SBS,..^,*"? -eSES/oSES.Pe) 
where AA is change in achievement scpre; T. V T, are teacher quality measures; 

i • * * * 0 

S l ~ S n ** e sch ° 01 <l«ality measures;, 6SES is genetic endowment socioeconomic 
status; and ?6 are peer characteristics. 
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The results supported the contention that a systematic evaluation of 

* 

inputs^in relation to output^, combined pith cost figures, can increase ''tfhe 
^ ^ efficiency with which educational resources are used. For example, Wife 

(1977) found that the cost per pupil was not directlf tied .to pupil achieve- 

\ * ■ • " : / T 

ment growth (as previously found; v Hanushek, 1977). He concluded that current 
resource can he used more effectively hy reallocation hased on production 
functions as in his stud^. Wolf e . (lftZ7T"also found that different expendi- 



— ture^atterns-yield-very -different-results and ,that : the appropriate expendi- 
ture pattern could be selected as a function' of the priority of goals from 

* • ' # • 

the multiple constit^uencies or the "dominant- coalitions". 

* ' f * # * ' / • 

While Wolfe's approach to cost-benefit analysis is an improvement over 

many previous attempts to; link- educational costs to outputs, 'the "major * ' 

drawback of the, study is that only-one criterion (pupil gain^scores) could 

he usea to. his operationli^ion of - effectiveness. As previously noted, 

Ebel (1973), Nunnally (1978)* and Soar and Soar (1977), discuss some of the 

„ problems with using pupil^gain^Stores on achievement tests. v In addition 

f ' * i- * . . 

numerous writers have cited the importance ■ of time frame on which the cri-. 

< ; '*'*"'••.•'.• 

^teria are hased (e.g., Mahoney ,& Weitzel; 1969; Yuchtmari &" Seashore, 1967). 

Effectiveness is oftjen divided into categories such as immediate (or short- 

run) , intermediate (middle-range) , and tlltimate (long-run) . Static, designs, 

which are ccharacteristic of cost-benefit analysis, ' would assess only immediate 

effects and ignore the impact of- ;mch effects as intermediate or long te.rm 

criteria* For example, the use pf cognitive measures as output at co ul d 

^faave dele£eri6us effects *on fi^e^i^ measures at T 2 or T 3 . Also, the ex- 

* , - <> * ■ - § 

elusive ^concentration on factors dealing with cognitive development could 
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•result in a negative impact on non-cognitive development at T, , T„, or * 

i m 0 <■ 12 3 

This could prove to. be a sferio'us proble^ at elementary educational levels 
"given the recognized importance of non-rcognitive development at this level 
and the implied linkage of cognitive achievement with resource allocation. 
The probata is similar to that which "is" characteristic of other goal-oriented 

* * 

approaches? that is/ attention is directed toward measurable objectives- at 
the expense of 'so-called ;nob-measurab^e, non-cognitive components (e.g., * 
"creativity, abstract reasoning),,. 

^ At this point a distinction between cost-effectiveness models and cost- 

benefit models needs t^fc ^ made. , While effectiveness requires the quantifi- 

»* * . 

cation of input costs such as teacher characteristics and facilities, the 

-outputs or benefits do not require accost' estimate /attached % them. Rossi, 
Freeman^ and Wright (1979) use* the example of a free textbook distribution 
program for primary school, children that may* have findings of cost-effec- 
tiveness expressed as" ,,f £* total project, dollars increased reading scopes' 

' % . •» 

by f y r amburfFS Thus, the textbook distribution program can be directly 

compared to some othfer fprm-of intervention, the goals of which are also ' 

aimed" at increasing reading scores*. ^Comparisons and -rankings of\choice 

can therefore be mad$ on the basis o& magnitude of benefits versus costs. 



• Related to tfir problems of tlie criterion (benefit) selected in a cost- 
benefit analysis is the underlying. a<icpun ting perspective to be adopted. * 
For example/ for educational programs, there are three accounting perspec- 
tivesthat could be used; the individual, the society-at-large or the ad- 
ministrating governmftit. Garms (1971), for example, in assessing the costs 
of a remedial education program, identified individual costs such as tuition 
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rates for college attendance, earnings foregone while attending college,' /<f 
and additional expenses while in college. The social costs identified we're 

opportunity costs (gross of taxes) and project costs.', The go vernmenf costs ' 

■ »,_.„ v . : • • 

were taxes- lost and any project costs incurred. Rossi et al. (1979) and* 

/ ■ ■- 

Glennan (1972) provide several examples illustrating that the same compon- 

ents comprising a cost-benefit, model may enter into the equation as; a' cost. 

from one perspective and a benefit from^another. It follows then that any^t 

ratio derived from the model will be a direct function of the ' accounting 

perspective that has been adopted. Paul (1973}- in ,an analysis of management 

education, presents an example of the extreme differences 'in ratios 'that 

" i " ■ J ' 

result from a change in the accounting perspective. 'Rossi et al. discuss 

• the detail^ involve* in "such an analysis '." * * *** ' 

..«!*.«,* r . • *\ 

While the different accounting' perspectives may result in " different, 
cost-benefit ratios, the adoption of an effectiveness 'model where benefit 4 

factors other than, for example,' earnings improvement- can be considered 

*■ * ' ° 

might increase the compatibility of different perspectives*. .Furthermore/ ** 
the deirivation, of cost-effectiveness models from the different perspectives 
could serve as the basis for discussion by the <mjiltiple constituencies? or 
"dominant coalitions" affeqting th^ system. Such an approach. would be 



deslrable thaa th * t is typically done when relative comparisons 

^ : — auat^-be^&e between various educational programs in order to decide 9 budget . 
ary matters (Pellagrin, 1976). Of course-, while this sounds like a better, 
approach to decision-making, it necessitates the pricing of variables that 
are not easily priced. What, for example,, is the price of the improved ' 
cognitive achievement of the* learning disabled versus that of the high 
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achievers^ or the development of .'physical abilities versus art or music 
appreciation? Asking people what they are. willing to pay for improved 
• .cognitive development of their children is one proposed method of pricing 
(Posav^ & Carey, 1980) but is inappropriate whenever the majority of con- 
stituencies are not directly affected by certain decisions /for example, 

pricing for 'special education programs that do not directly affect- one 1 s own 

•' - - • *« 

children) . „ ' ' . 9 ' > 

Another problem with cost-benefit approaches for school systems is^hat 

the preoccupation with economic, analyses (.e.g., earning power) tends to 

devalue the importance and 'quality of human life. Little consideration, for 

* • • 

example, is given to factors such as life satisfaction other than how it 

-relates to earning power (Abt, 1977) . This problem is related to the dif f i- 
culty of pricihg*certain benefits . Oftentimes when prices are"*assigned to* 
benefits, the decisions for pricing. are arbitrary or purely speculative (e.g., 

' Levin',; 1975) . ✓ •' * , . 

Macy and Mirvis (1976) describe the development and implementation of 
a. standardized set of definitions, measurjgls T and costing methods for various 
behavioral outcomes" related- to the quality of work life. In a longitudinal 
♦study of manufacturing and assembly plants, the authors derived dollar figures 
foif four Variables ^related'" to member" participation (absenteeism, tardiness, 
turnover, and work storages)' and six. variables reflecting role performance (pro- 
ductivity, product or service quality, grievances, accidents, job related v 
illnesses, and unscheduled downtime) . No studies could be found in the edu- 
cational literature that, assigned dollar estimates tJ as many salient variables. 
Additionally, | no attempts cbuld be found where administrator, teacher, or 
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student attitudes are assigned dollar values (see, for example, 'Mtrvis & 
Lawler, 1976) . Thus, In terms of a lar£e scale model d£ schopl 'system 
effectiveness, applications of a cost-benefit approach have been largely * 
incomplete* However, when educational ■ decisions are^ closely l inke d to • 

r m 

dollar costs as benefits, cost-benefit or effectiveness approaches should * 

prove to< be a valuable -input: It must be stressed, however,, that for the 

practitioner concerned with Increasing the effectiveness of a school system ' 

cost-benefit analyses are only one factor that should enter into an effective- 

-ness model. * There are additional factors (i.e., inputs) that are difficult if 

3 ' * ■ 

not impossible to operationalize *xt dollar amounts (e.g., teachir behaviors ,' 

' ' * ' " \_ V ■ ' 

student attitudes, organizational- climate)... Thus, a cost-benefit analysis by 

itself is not appropriated assess school systems effectiveness but could be 
beneficial when used in conjunction with other approaches . 

Human Res ource Accounting » Other than as 'discussed, above in terms af 
earned income and relative program cost/benefit ratios, there have been few ■ 
attempts to apply principles of human resodrce accounting (HKA) ' to the 
measurement of educational efficiency. The theory underlying human resource 
accounting is that the value of humans to an .organization can be determined. 
The different casting methods are surrogatest-of the actual value of the , ° 
human organization. 

_ _ _ _ • * _ i » * , • 

Flamholtz (1974) has made, extensive studies of the value- of an indi- 
vidual to an organization, or the individual's expected realizable value. 
This theory recognizes several elements which give pebple^value as human re- 
sources because they 'represent potential services to the organization (e.g., 
skills and activities of persons upon entering the- organization, reward structure 
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of the particular -role, promotabili£y, and turnover). ' This 'theory identifies 

' ' %'' . h 

major factors .which constitute a person's value and organizes them into a 
logical framework.. ^- „ 

With regardvto assessing the valu#*>£. the total human organization, 
Likert (1973) has developed a basic theoretical approach. Likert's work 
actually' could be considered, the basis for.-the' current interest .in HBA\ His 



. human, resource ace$||fctng mpdel included causal-, intervening, and end-result 
variables. • He ■: stressed in his model* the interactive nature of all variables 
within his mpdel with managerial- leadership 'c^jjic'eived as -the causal variable. 
He^later" included prganizatiohaI : ^ruct^ie- as a causal variable, as* wel2^ as 
discussed the influence of this' j»riable»°on intervening variables such as 
organization climate r peer^eaaexship, group processes (planning, coordinating, 
decision-malSlng, -etc.); and subordinate satisfaction. The intervening var- * 
iables in turn affect the end-result 5 i.e., t£he total productive efficiency). 
Likert posits differences lnthe magnitude 'of the relationships between the 
structural. variables and. the intervening variables. Such an approach could 

4 

also be presented in the' context of the iganagerlal ..process model of effec- 
t&veness* 0 

* Likert (1973) suggests that the causal and intervening variables can 
he .m e a sured b y-existing socio-psychological toola^JThe^aausal^Jiuman organl- 
,zat±on scores then can be related to unit ."production" costs through placing 
dollar^ values on changes ♦ In the educational domain, however, attempts to 
relate teacher training costs, for example, to output measures such as 
student achievement have been largely fruitless (e*g», Averch et al., 1972; 
Hanushelt, 1977) • The educational studies,, however, have been 'far less 
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sophisticated in their measurement strategies and make no attempt to relate 
human resource accounting principles to teacher or administrator management. 
For example, using past human resource costs, standard costs for- the acqui- 
sition of a new" teacher or principal in a certain position could be^ developed . 
These could be used to evaluate the efficiency of teacher recruiting and 
hiring much as standard costs are used as. guidelines in a production depart- 
ment. "The areas where costs are greatest could be determined and possibly , 
reduced. If costs need to be reduced, it will *be an informed reduction 
rather tnan an arbitrary cut back as is usually the- case (Pellegrin, 1976) . 
Standard costs are always useful for the practitioner in budgeting. If the 
njpber^of positions needed 1 to be filled! is available, an appropriate budget ' 
for personnel acquisition can be determined. 

Capitalizing training costs would decrease the tendency *of management 

* *■« 

to view training as a ^uxury item. Training costs could be accumulated "in. 

the asset accounts of the individuals who' benefited from the training sessions 
♦ and matched later with output it helped to produce'. School administrators 
. would be encouraged to upgrade their continuing education programs since the 

• \ f* *-* m il- " 

programs will ffe evaluated by long-raiage^restdtS (increased performance) 
rather tfxan short-range increased costs. The evaluation would include a 
return on investment figure being computed for human assets as well as 
'physical and financial assets. Additionally, HRa data is useful in evaluating 
turnover. If excessive turnover occurs, it will be reported as losses on 
the budget statement. ^.Basset (1972$ presents an analysis of employee turn- 
over that has application to problems such as "high quality 5 ' teacher turnover 
and "low. quality" tenure. ' 
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Tomassini (1977) , in a study of layoff decision preferences comparing 
the decisions made with and without access to HRA information, tentatively 
concluded that HRA cost . estimates caused different managerial preferences s 
In the decision to layoff personnel, ^n this case the ERA costs included 
costs to rehire, and to hire and train new workers to replace those who did 
not return. Not all of ' the subjects with access to HRA data made- the same 
decLsion but none geared to have ignored the HRA data, 

» Several models have now been presented for HRA (Craft. & Birnberg, 1976). 
Further research should concentrate on empirically testing these models. 
Before school systems implement HRA methods, they need to see whether the 
benefits will exceed the costs. One advantage for the practitioner is that 
implementing the system need not be organization-wide at first. AT&T, for 
example, has used HRA in measuring the cost of employing and developing 
toll directory and assistance operators (Stone, 1972)'. This was a problem 
area for the .organization yet. one that could be objectively measured in terms 
ofr costs. -A similar approach couid be adopted for educational systems with' 

a concentration on one major personnel segment such ad teachers. If the 

r v ■ 

system is effective^ it can then be expanded to include other segments of 

*» * 

the school system. * 

While there are numerous journal articles that"di§cuss HRA and provide 
the proposed advantages and uses, there have been no pure applications of 
-HRA, to, educational systems. The next logical step should 'be implementation 



on a limited basisnand a reporting of the results. If HRA is to be used 
in a cost-benefit or effectiveness framework fpr school systems % it is" 
necessary • for educational management to be familiar with HRA and its uses 
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,, and to test and .implement its principles where appropriate: It is also 
necessary that practitioners be aware of the fact that while HRA can pro- • 
vide a. valuable input for school systems, one should be cautious not tp base 
effectiveness decisions on HRA alone. It is recommended that HRA be used 
in conjunct|on- with the functional r model of effectiveness. Combining these 

two models would allow -the practitioner to evaluate "means," "ends," and 

■ 2 ■• * •> 

costs. " J 

f * Systems Models 

The second •major* view of organizationalVeffectlveness is the systems 

> view (Campbell et al*, 1974). This 'model regards the organization as a 

/ • 
natural whole or system. Realization of goals is but one component of the, 

> measurement of effectivenesT^i this model-. Rath*,- the organization adopts 
" the' overall goal of maintaining its viability or equilibrium without deplet- 

ing its internal or external resources., The organization is seen to be in' 

a constant state of flux, with its structures spontaneously and homeostati- 

cally maintained '(Ghorpade, 1971). Etzioni (cited in Steers j 1.976) argued- 

" . ... ' 

that this, approach was superior to tbe goal-oriented approaches- because it 

focused on the system at works, Gedrgopoulos and Tannenbaum (1957) also main- 

t 

tain that. definitions of organizational success must consider not only the 
objectives of an'organizatiqn but also the ■ mechanisms by which it maintains 
.itself and pursues its objectives. The' focus is thusW "means" as well as 
"ends.'t . \ < 



The systems approach is based on an underlying organismic model that . , 
stresses the interdependence of the various subsystems. - To assess effec- 
tiveness under a systems viewpoint, one should ascertain the extent to which 



■r ■ 
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aa organization is internally consistent, whether resources are being judi- 

ciously acquired and distributed over a wide .variety of coping mechaui'sms, 

' ' * '" ' 

and if the organization is adjusting to- a constantly changing environment • , 
..> ' . ■ • " • * "'• '.•*'. 

(Campbell et ^1. v 1974) . This is a very dynamic perspective*. Indeed, - ■' 

Ghorpade (1971) states that systemic criteria of organizational effective- - 

ness are' derived from conceptualizations of "needs" experienced by the or-*.- 

ganization as a "living" social system.- Needs refer to recrements that 

organizations have to nfet.'ln order, to survive. Conceptualizations of needs 

;and their criteria take many forms (^teers, 1^6). Behnis- £1966} In fact; 

-conceptualizes the* problem from the perspective- of mental health.- 0 ' * 

The reliance on jgoals, however, is sjrill very much in evidence -'in seme. !■ 

systems models. 'Ghorpade (1971) notes that Parsans and Etzioni', -two staunch 

advocates of the systems approach, both insist on linking effectivenes^ with 

goal attainment. They view- the organization as 'one subsystem in i larger ' 

social structure. Organizational goals emerge as outputs for the society. 

Judgments of .organizational worth are made in terms of the quality and ' 

relevance of the r organization's outputs ^toward assuring the growth and' 

survival of some other system, usually [society at' large . However, social 

h 

accountability, ? an important issue for school systems,. has not been formally 
recognized in any theoretical system or framework. In addition, any systems ^ 
model that incorporates the concept of. goal attainment is sub ject . to . the same 
problems noted earlier about goal-centered approaches . * * ' 

Presented in Table 2 are five of the more prominent systems approaches 
in the literature on organizational effectiveness/ The table summarizes 
these model* with respect to their applicability to school effectiveness,^ 
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A detailed discussion of these models in term^of their theoretical under- 
pinnings, empiric^^upport (where Available) and Implications for the 
assessment <jf school effectiveness will follow. * . » " 

9 Insert -Table 2* about here ^ 
The Systems Resource Model * 

Systems-resource models define organisations as several subsystems inper- 
acting with each* other (Etzioni, 1960; Katz' & Kahn, 1978)'. Effectiveness is 

defined as .the degree tp which the subsystems work harmoniously to satisfy 

i 

needs of constituencies. Cunningham (1977) states that the key to effective- 
ness, is a balanced distribution of resource? among the various subsystems, not^ 
m fl ytwil satisfaction for^all subsystem needs* ,Ka£z and Rahn (1978) write that 
the "ultimate justification of an organization's existence and its claim on. 
Scarce 7 resources is its throughput, its 'transformation of energy andlfcerial 

* < * .» ♦ 

into fonwi and locations valued for .reasons and by^ individuals outside the- or- 

ganization. ' Xhe more the throughput, the better its' quality, and the less con- 

suming the transformation' process, the more we call the organization effective" 

(1978, p</246). Yuchtman and< Seashore (1967), tfho aljso adopt an open systems 

tfeof -organizations, define effectiveness in terms of an* organization's 

bargaining- position or the Ability of the organization ta exploit its environment 

in the acquisition -of scarijf and valued resources. Thus, the *nly relative com- 

can be, made between organizations is' in the. sense of -ability to « 

;ompete f 6^, valued resourc is. If should 'be noted that Yuchtman and Seashore 

^ (1967) emphasize ^ability" to compete father than' the measurement of Actual 
<*" „ ' * • * • ■ 

acquisition of resources'. *tt is of course difficult to conceive of howv, such * 
' ' '* • v " 

"ability" could be assessed except ■ through the acquisition of resources; ' % 
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Price (1972) and others have, argued that the acquisition of resources 
If. the operative goal- of the organization. Katz and Kahn (1978), however, 
maintain' that the "throughput" represents the primary goal of the organiza-n 
tion that has been set by "the relevant constituencies of /the organization. 
Effectiveness can then be defined in terms of the attainment of" these goal!" 
given certain specified constraints. Therefore, for the practitioner, it 
would be .possible to specify. a single criterion of effectiveness (e.g., 
.^achievement test scores} given these specified constraints. ~ With, respect 
to educational systems'* constraints' such as- community characteristics and 
pol£%cal. attitudes must be taken into consideration when measuring effec- 
tiveness* Barro (1970) -also maintains that adjustments must be made in 
teacher characteristics acrda^ districts because such characteristics qannot 
be controlled by administrators. However, is difficult tb discern how 
factors under the control of administrators such as teacher recruitment, 
personnel selection, resource allocation and working conditions would not 
have an? effect on teacher characteristics . Other obvious' constraints that, 
may .influence measures of effectiveness for -sNchool systems are the charac- 
teristics of the population of students (enfcry-level) , the market for all 
school personnel* the physical facilities available, and *he resources avail- 
able. Yuchtman and Seashore (1967) would probably maintain that for school 
Systems variabj.es such as tax 'base, or percentage of budget represent the 
bargaining component o£ effectiveness and, is such, are not constraints on 
effectiveness butfrrather measures of it. TOis, in their conceptualization* 
j of j effectiveness, a bargaining variable suteh as percentage of total agen6y 
^budget aigfct be appropriate for comparisons between two school districts. * 
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While there is certainly a goal-orientation to "throughput" frith the 
sys teas-resource model, there is a concomitant concern 'for the maintenance 0 

. of internal^nay-to-day actiijities and the ability of the organization .to 
integrate .^elationstfips between its various subsystems (Cunningham, 1977; 4 
Etzioni, ltysy. Etzioni <1975) writes- that the ^'starting point for this 
•approach is not the goal itself but a working model of a social ^unit capable 
of achieving a goal- . . . it is assumed a priori that some means have to 

;be devotfed to such non-goal functions as service and custodial activities, 
including means ecjployed 0 f or : the maintenance of 'the unit itself 11 (Etzioni', 
1975, p. 135).' Thps*, it is tHe systems-resource perspective that considers 
means as* veil as< eiMs in its conceptualAfation of effectiveness. A pattern 
of interrelations among the varioqj^^g|^zatidhaI subsystems is defined as 
the effectiveness model. In this sense, then, the systems-resource model 
resembles the organizational developmerit model, to be discussed later, in 
that a set of assumptions regarding organizational characteristics ire de- 
fined a priori as assumptions predicting or corrected w£th ef f ectiveness ^ 

To Katz and Kahn (1978) and other open system theorists, effectivenesses 

' * • — * *> ■ 

most .dependent ^'on ^ drgaxjizatipi^s^ efficiency. Efficiency is critical 

because the survival ot< an organization is a function of~its negentropy or 

the ratio of imported energy to returned outptft . Thus^ an output/input 

ratio of UOO would represent an ideal statfe of efficiency for a school 

sysfenr. For the practitioner, then, -the logical questions to follow from 

this conceptualization are: (1) how much output do we get for a given 
* > . . * 

input; (2) how much input must' we invest to assure a given output; and (3) 

is it possible to compare the relative efficiency of tyo or m^re similar . 
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school systems? * 

\ The output/input ratio will -tell us how weir r k* school system is using r 
r * " 
the energy '(Inputs) at its disposal and how much energic investment is re- 
quired for a given Mnit of output. In an educational setting, energic in- * 
vestment would entail such variables as personnel costs, supplies, power, 
facilities* -etc.,, (O'Dopbgkue, 1071). It is in the measurement of. the out- 
put variables that problems dfevelop. Very often, simply the nu m ber of 
students who have passe* ± certainHcadpmic hurdle op graduated" is taken* 
as the measure of output. With this con<ieptuaiizaS^m» comparisons could 
"be made between two t educational systems that are .essentially comparable-in 

• terms of input variables with the exception that one "system maintains av x ' 

•"- .<• . 

teacher-student class size ratio ^of 20:1 while the other Is at 30:1. ..Using 
an output Variable such as the number of percentage of "successful" graduates,-, 
it is clear that the system with a 30:1 ratio -is relatively more efficient ' 
than the other system, (while both^ systems are operating' as designed, one 
system is relatively more efficient than the other. ; 

One flaw in this notion of efficiency when applied to educational systems*, 
is that the relative superiority of the 30:1 system ma£ be evident only so 
long as the output criterion is the sheer number of griduates. Perhaps the 
system with higher teacher-T gtude nt^ratios also is characterized by higher 
teacher turnover, absenteeism, or lower student achievement, and satisfaction. 
Thus, we once again return to the old "criterion problem" with regard to the 
measurement of efficiency. If constituencies can agree on.^afcpropriate ovt-^y 
'put measures and energic inputs can, be \reliably and adequately measured, «. 

* * , : . » >« ' ' * f * 

*•**_ * - • j 

ttjen efficiency would, be an^appropriate operationalization of school 
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effectiveness. There is general agreement j however, that the measurement of 
both Input and output variables is inadequate and the very inadequacies of 
this measurement will tend to reduce the efficiency of school systems.. As 
decisions are made in areas such as resource-allocation on the basis, of data, 
to the extent. that the dataware injilid or limited in scope, so also will 
.be the decision * . ,! K» an exa^^, while few educators 'would argue with the 



contention that the lower the teacher-student -ratio 1 ,' the greater the student 
achievement, empirical studies in this area for the mdst part afe not sup- 
pbrtive. Hanushek (1977) writers that "almost uniformly^ educational produc- 
tion models -show^no consistent- or significant;- relationship between achievement 
and expenditures per pupil Teller instructional expenditure or total ex- 
' penditure)" (p.. 47). . * 

Current attempts to refine the measurement of organizational input and 
output variables have focused on some form of dollar criterion -to be assigned 
to variables' previously unaccounted for. As mentioned earlier, Likert (1967) 
and Flamholtz (1974) have -applied- human resource accounting primaries in 
order to assign dollar estimates, to input .variables such as employer exper- 

ience, selection, training, etc* However, there have be^n few attempts to 

■ • ■ * * ' / 

apply cost accounting principles to* output variables in an open systems 

context (Popham, 1975). In Parson's (1956) analyses of social structure/ a 

scho<^ system's .functions ^^effectiveness can only be considered , in terii^ m 

of its contribution to the functioning of the next higher order of social 

structure. Thus, cost accounting principles could Conceivably be applied 

to school output, measures such as "drop out" ratef percentage of students 

who go on to college or. technical school, perceniajge of unemployed graduates, 
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etc. Such output measures would get closer to' answering the question of 
jTxowwell the organization, is doing for the suprasystem" (Katz & Kahn, 1978, 
p. 2465; ^Wijn tihis (jpnceptualization of effectiveness, there are many sim- 

v 

ilarities between Parson's <1?56) functional model and Katz and Kahn's 
systems-resource model. However, Seashore and Yuchfcman (1967) take the 
position that, such an approach neglects the independence 'of the organization 
and, its -exercise of choice. With their perspective, maximization of return 
to the organization underlies the measurement of efficiency. However, to 
use a measure such as percentage of total agency budget in order *to make 
relative- comparisons between school districts ignores the ramifications of 
budget increase's on- budgets of other suprasystem agencies. Also, it would, 
be virtually impossible j:o control for all extraneous factors, that could 
affect such a measure (e.g., general state of the economy tax base). Fur- 
thermore, in viewing a school system in the context of its suprasystem (e.g., 
the cc>mmunity, local government, etc.), it is probable that one particular 
l£vel in the school system hierarchy may have incentives that prove to be 
disincentives "at another level within the hierarchy. For example, the "cost 
savings" rea^Uid by one level / e *^ administration) may btf represented as 
"cost^atfoidances" to. a level aboye the school board (see also the discussion 
on cost-benefit models) • • * . 

In summary, the major, problem w^th the systems resource model as 
applied to school systems effectiveness is the development of an acceptable - 
standard for efficiency that takejs^nto consideration the interaction of 
school. system effects with' effects' of other institutional subsystems within 
the organization's suprasystem {O'Donoghue, 1971).. The problem is compounded 
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by the fact that issues related to efficiency such as resource allocation 
areS^Losely linked to community political processes. Research indicates 

^pllegrin, 1965 r ' 1968) that in matters of resource- allocation, 

* » 

issues specifically related to education red&ive lower priority than 
matters related to economic and governmental affairs. Pellegrin (1976) 
discusses how the "community elite 11 spend little of their* time and effort 
ruminating over educational issues and yet they make decisions that often 
dirfectly affect educational outcomes. In education, the most common measures 
of efficiency are student/faculty ratios,- costs per faculty member* costs 
per student, and costs per square footage of space (Bowen & Dougjas, 197L; , 
Cameron, 1978; Hartinark,^ 1975, teeth," 1972; O'Neill, 1971)% .While theses 
operationali za tions are certainly important in terms of indicating efficient 
uses of resources, they bear little rejLationship to operatidnalizations of 
the effective use of resources (i'.e., producing outputs)* Fincher (1972)* 
concludes that it is Impossible to assess both efficiency and effectiveness 
,in education using the same criteria and that the emphasis sSould be on * 
measures of effectiveness. The preoccupation of systems - resource models • 
with the measurement of efficiency make the model largely inappropriate for 
educational systems. J ^ 
The Func tional-S true tur e Model 

The functional structures model is probably best represented by Pennings 1 
(1975) "structural contingency" ^jj><tel which states that organizational struc- 
ture is^ in part: a function of ^environment and technology, ^he environment 
is the many parties with which the organization interacts (e.g., parefits, 
students, teachers, and. tax payers). Technology refers to the organization's 

• . . ' V • •. 
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mode of operational, e^t&e Way it converts its inputs /into outputs) . 

This model proposed tnSt Organizational effectiveness v is a; function of the 

; > _ * - - • , / , v v 

interaction of relevant technology and* the organisational .structure* Un- 

fortunately, ,the mbdel lacks both a methodology for assessing afcfst Environ- 

' * ** 

mental factors tod -hypptheses t&at would clearly pejrtain to educational 

\ 

systems. * * 

X 

' * i 

While many of the internal structures that ha^re been studied in the 
context of the functional-structures model (e.g., decentralization, special- 
ization^ formalization) have ^also,. been "con^i^red 1 f or educational systems, 
none, have been closely linked eo measures of schobl system effectiveness / 
(Averch et\al fc> 1972;; Hanushek, 1977' K Madaus et al., 1980; Mbhr, 1973). 
Cqtanentirig on the ,sfcj(icture reseatch conducted in educational settings, Mbhr 
(1973) had stated that few hypotheses catt be found *with regard to how cer- 

tain structural inputs will affect school outptits. He states further that 

• f - / 

factor analytic research involving a variety of input variables has been 
largely fruitless. m .t * 

A major limitation of the functionai-stfcuc^ as applied to 

school systems is that; it has b t een principally, .concerned- with the satis-' v 
faction of^basic needia that should probably not be the v focus of a motiel of • 
schpol system effectiveness, (e.g. 9 the security of the! school system in 
relation* to its environment; the continuity of policy-making)./ Furthermore, * 
'the eyaitiaUon criter&^for this mod6l hage most often involved profitability, 
the acquisition of resources such as money; people, or goods, and investment 
in the aystemi tfifo^uih' goods or people Tgtymainghem, -1977 j^Selznfck', 1953) 
criteria which are, not partiqriarly applicable to public school systems. 



School Effectiveness - 



\j - . ' 

■ ' \ 

Grayson (1972). discusses the need -to implement an educational technology 
which involves curriculum design and redesign based on a priori criteria. 
While his discussion resembles Penning f s notionTof the structural-technological 
„ interaction, the approach more closely resembles the systems-resource perspec- 
tive proposed by YucifjaflS and Seashore (1967), Katz and Kahn (1966), an<T 
others, 

Miskel, Feverly, and Stewart: (1979) maintain that there have been three 

common deficiencies- in research on educational structure variables- and 

school, outcomes. The fiS££\deficiency is that the majority of empirical 

S V * 

studies look at oply a portion o£ the theoretical domain r 1 Two examples 

are Miskel .and Gerhardt (1974) who studied the relationship between^ perceived 
bureacratic structure and teacher satisfaction and Anderson and Tissier 
(1973), who s'tudied the effects of school decentralization on student aspira- ' 
tions. Miskel et al. tl979) state that there have been few attempts to 
study effectiveness in. any multidimensional, ^framework where multiple criteria 
are related to structural or technological variables. 

The second deficiency of the literature oh educatidnal structure ac- 
cording to ; Miskel et al. (1979) is the preponderance of conceptual or theo- 
retical papers that have a total absence of empirical dajfca to support their 
positions. Andes (1971) and Hanson .(1975) are cited ,as examples of such a 
deficiency. 

TKe third deficiency has to do with the-unit of analysis that has been 
* * * . 

used in much of ^the research. Many studies ufci the individual as the unit 

of analysis in reseaigh on variables such as decentralization, formalization, 

bureacratic jtructure, and climatJe (e.g> , Nirenberg, 1977 ; Odetola et al., 
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1972). Mlskel et al. (1979) maintain that technological and "structural 
variables of school systems are mora appropriately studied from the per- ' ■ 
spectiva of -the- school or the district. If school processes are the focus 
of the research, the unit of analysis should be the larger organization. 
•Hannan, Freeman', and Meye|f;$^75) make a similar argument in their critique 
of Bidwell and Kasarda's ^975) study of school systems' effectiveness. 
Hannanlet al. contend that the use of„a unit of analysis with data aggre- 
^ gated "above the theoretically appropriate level can lead to the "inflation 
of errors of mispecification" (p. 139). 

To illustrate their argument, they reconstructed a data set comparable 
to that used by Bidwell and Kadarda to illustrate the manner in which the 
unit of an^ysis^roblem can lead to overestimates of the impact o£ organi- 
zational variables on effectiveness (as defined by achievement test scores). 
Their reanalysis suggests that the effects; of organizational variables/ are 
smaller than that reported by Bidwell. and Kasarda (1975). J Such finding 
is certainly not, justification to exclude organizational variables* from 
effectiveness models, but does suggest that careful attention needi to be ^ 
paid to the unit ef analysis, as recommended\by Mlskel et al. (1979). It 
^should be pointed out, however, ^ha^taggregated data does not always produce 
Inflated correlations as suggested pj Hannan et al. (1975). Aggregation can 
In fact result in more unreliable data than individual data ($.g. , where 
there*is substantial variability in abilities or attitudes within a given 
work unit; Schneider, 1978) . Thus', In the selection of ' a unit of analysis, 
-the practitioner should be concerned with the interpjretationai compatibility 
.between ttfe statistical and the theoretical models selected for study. 
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In a well designed study relating school structural variables to multipl 
, evaluative criteria, Miskel et al. (1979) employed the school as the unit of 
analysis in their investigation of the effects of several structural and 
process variable^ on multiple outcomes of perceived organizational effective- 
. new. Adapting the theoretical perspective of Mbtt (1972), Miskel et al. 
(197,9) defined effective schools as "those schopls perceived to produce 
pro'ducts and services in greater quantity, with better quality; to show 
flexibility; and to exhibit adaptability to a greater extent than %ess 
effective" organizations" (1979, p. 99). 

The three dependent variables used in the study were loyalty, job 
satisfaction, and an overall measure of school effectiveness. In previous 
research (e.gr., Hoy, Tarter, & Forsyth, 1£78; Ratsoy,, 1973) , teacher 
loyalty and satisfaction had been shown to be related to group productivity. 
Miskel et al. (1979) adopted the position taken by Campbell et al. (1974) - 
who believe effectiveness is best assessed by perceptions of relevant con- 
stituencies. Thus, perceptions of school system effectiveness were recorded 
from teachers £t 125 elementary and secondary schools. Much like the func- 
. tional-structures research by Penningsand his associates (1975, 1976), on4 
independent^ variable of interest was organizational structure (defined' as 
the relationship -among different roles that "are created to achieve educa- 
tloxutV goals . Variables such as stratification, complexity, and centraliza-^) 
tion f^BUn this general o category of structure. In addition, Miskel et 
at. (19 7^ studied several organizational process variables in a framework 
compatible with Likert's (1967) organizational development model (see below). 
Thifvtnodel is concerned with factors such as Ifeader behavior, motivational 

73 
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forces, and interaction-liiflnence patterns^ Miskel et al. used Likert's 
(1978) Profile *o f a School questionnaire to assess these factors. N 

With results tha^ corroUorate non-educational research in a functional- 
structural framework. (e % g., Bemffngs, 1)975), results indicated^ that effec- 
tive schools are. perceived as having higher professional development and 
being more participative, decentralized, and formal-ized' around rules. • 
.Miskel et al.' (1979) $onclued that environmental contingencies (e.g., com- 
munity chatacterisjbic^) can. have a strong impact on outcome variables. Re-' 
suits supported research by Hoy^Newland, and Beazpvsky (1977) who found 
tha£ centralization reduces morale but that increased formalization increased 
teacher satisfaction. Findings regarding participation % were also in line 
with predictions from Likert (1967) on System * managerial style (see below). 

As stated above, the sSelection of a unit of analysis in studies ofSjfe. 
school productionSfunctionis or effectiveness is critical in terms of the 
interpretation of the results. The issue is usually 'discussed in terms of 
the use of aggregate data to make inferences about individuals (e.g., 
Morgenstern, 1963; Robinson, 1$50),. Directly related to this issue is the ' 
assumption a researcher makes witl* regard 'to the independence /interdependence 
of observation in the st^idy, , Research .on educational production^unctions, 
for example, has consistently assumed 4 the independence of observations when 
statistical inferences are made (e.g., Hanushek, 1977; Law,- 1977). dick 
and .Roberts (1978) discuss this issue witfi respect to major theories of 
human motivation such as expectancy andiequity theory. The problem is 
treated in the context of bivariate analysis of individuals Versus groups- 
of individuals, . holding all other important^ characteristics cqnstant. They 
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state empirical verification must determine the degre^ of interdependence # 

of the "units" in' a study. Thus, in the educational context, the extent '"to 

which ^the observation of an* achievement level ofra given student is depen- 

dent on the achievement level of other students., and the exten£*to whi^ch a 

classroom's achievement level is affected by otitae classrooms must be empir- 

ically determined in order -to properly partition the variables under study. 

ft' 

Cronbach (1976) and Firebaugh "(1978) point out tt&t the aggregated construct 
is usually recognized to be separate from the individual construct with dif- 
ferent assumptions regarding anJfeedents'and consequences. Thus, for exam^ls 
school effectiveness is not the sane thing as individual performance. 

Group scores (e.g., scores aggregated at tha^ classroom, schA^l/or 
district level) are considered appropriate when a group score is- used to 
predict some individual variable. - If the group score can, however, be broken 
down into ^individual scores, the use of group boundaries provide^ ffrr th^ 
partitioning of within-and between-group portions of the variance. This is 
particularly important in breaking^own classroom effects from, for example, 
school effects. In terms of the partitioning process, there are several 
suggestions (e.g., Farkas^, 1974*; Glick & Roberts, 1978; Kraemer,* 1978). As 

far as predicting Individual student Ichievement, however, (the most common 

„ ' , \ 

dependent measure in production function and school effectiveness research), % 

the partitioning ^process that makes the most sense favors 'interpretation of 

the maximum amount -of variance at the individual tfoit of analysis (see the 

arguments made by Freeman, 1978 and Hannan et al., 1976). f 

Gliqk a^id Roberts (1978) state t that a definition of group boundaries > 

* »* ^ ~ 
< is necessary, whenever there is a hypothesis as to the interdependence of a 
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set of individual scores. The extent to which regression and/ correlation . 



coefficients are. biased can only be (determined if .estimates/tof "composir 
ttlonal effects" >(see*Werts & Lixm t \l97l) can be made. 

tual variables can be estimated, ita# impossible tofjaket. inferences across 
levels^of analysis asf for example, kn Bidwell and Kasarda (1975) J In 
assessing, the relative contributions of school-(related variables on student 



outcome!^ (the group boundaries «must be specify?, the extent of « their intfer- 

dependence estimated, and, if possible, /the direction of causality hypothe- * # 

VV „ ^ / % 

dups* * - .& ■/••»• 

In addition to the concerns expressed above, several authors' (e.g. , 
B^dwell, 1965;- MDhiT, 19Z3;*Pelleg*rin, 1976} havFcommeuted on the .lack of 
godd'instriimentkt^ of" schopl structural and technological var- 

iables , On& example |of • good measurement Ig. sfpuud in Bishop and George , ^ 
U975) who developed aSstructural Projfe^ie? Questionnaire" ;to measure an ^ 
organizations characteristics.*^ Thfs"^tiestionnair4 has been used as the 
measure of .school bureaucracy in seve«ar* studies (Miskel et aT., 1979; 
Murphy, Bishop, & George / 1975). However, for the most part, research 1* * 
education that most dearlj^^ches. the/functional-structurfe? jnodel^of effec- 
tiveness £s plagufed by the same problems of design and methodology discussed 

by Pennings ^1975) . While the func'tidnal-^tructures model £fcsel£ looks- 

» • .' # / ' < C * 

promising as a model of school system* effectiveness, more research,* utilizing 

* » '» * 

; Multivariate "designs and larger units of analysis, (e.g.-, school or .district) , 



such as the research con4ucted by Ml^el et al. (1979) / is' needed before a 
definitive statement c^n be made on ^ie appropriatetfess of the functional- 
' structures modei for. school systems. ^ 
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£ ' The Managerial Pre 

Th& managerial process modtel operationalizes an organization' s t ef£^p- . 



; tivenesa wtthin,the context of abilities' to. perform Urtain- managerial func/^ 
fc . t #9*» Fo f example, the extent to which' a "principal or school- administrator 

■' \ , . ' ' '. r» * * - 

-. effecttyely, performs the functions' of decision flaking^ budgeting, or planning' « 

would be a : -common].reie^rch? strategy. 'As denoted by its. title, the focus of" •* 

this model ii on'tfhe administrator's, 'or manager's, effectiveness, parttcu- . 

larly in -integrating individual goals with organizational goals. Thus", 3. /• 

•measures of employee 'job satisfaction, motivation, productivity, and beliefs 
• " r f * • . . 

are the,,most likely dependent measures for this model. Some discussions of 

•.-./' . ' l 1 *\ • ■ ' '• 

'this, model sound very, much like discussions of Likert's "principle, of suppor-'* 
' • * ' ' • • ' • v ' « - h *. • ' . 

>tive relationships" Clikert, '1961) r ,' Predictors of managerial success in. V '* 

*• » . * " * * • 

decision-making, _etc» through motivational or attitudinal measures are likely 

independent .variables'. of interest. ' . " <# >' ? * ' . 

. . > ° "' • ' » . » • 

. Reiman. (1975) studied managerial attitudes toward /'critical others" 

U'v* r " wfao could, potentially affect, an organization. This research is/ one of the. - 

* " . ■'- /' *' • . . * / .- -1* «.r-»- 

» better represeutations^of the i managerial process model. * His /Public Values 

v--» : ;\ • -.. . ' . . • * ■ \ ■ 1 . , / • : 

^ of Management" questionnaire was developed' to-studjr the.rej^tion'ship between 

; pt&lic-aector managerial attitudea and effectiveness «as measured by 'perfor- 
x '^\«ttc«« m iScores da the jxxestipnnaire were 1 found to tie .signif icahtly ^related : 

..v ; ' * 1 v v. ^ ' • " ^- " " % • 

.:: to g|»up performance aiasures. , While several writers 'in the educational 
- domain make reference te .;the crucial nature- of the principal's functioris and 

. % * * : •.;*'••■ ' '. , " ■ ' i, 

"<»n«ld«.r thep In the context' of managerial thedry, there . have bSfen few 
' : ;Pf * i&UMb&i fttelap taf- to ^empirically'' study .flie relationship between" attitudes ' 

" H" •"' ' 4 .°**5i^«teip*l« *nd educational outcomes (e .g; , Barro, 1970; Dyer, *197Q; Heil^ 

-v v' •.'. : *- ' •* '-/•' . * . 5. .» . * 
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1962; Radnor, 1974; Silberman, 1970; Stanchfield, i976) . Empirical research 
in the educational setting has concentrated on. variables" such as principal 4 > 
race,. age, sex, educational attainment, tenure, salary, and 'full or part- 
time positions as. they relate -to various outcome- measures (e.g., student 

; galxt scores; Averch et ale, 1972; Coleman et el., If72; Hanushek, 1977). In 

* * x . • A 

general, factors related^ to the principal' 'have been found to contribute 
-..^ ai ^ tr ^^ al amounts -of .variance in the^ouAome measures. More job- 

related" variables within both the ability and theiftlitudinal * domain would ' 

<■••,- . 

Y >-v" • * 

seem to* be a richer so^e^for predicting outcome variables.* -For example \ " 

?• Mahop^y and Weitzel (1969) concluded that effectiveness^ was a result «f the ; 

*-,»' additive co^ination of productivity-orientation, planning, reliability and 

initiative as related to managerial functions. ; Reliably measured ability 
t / ■ • . \ • V ' . \ . ■ s . : • 

^ / and att^itudinal Variables for principals that 'are directed 'at these Issues 

would seem to have a far greater^otehtiai for predicting educational out- 



cooes* 9% s ' \ 

Other researchers have looked at school administrators in their managerial* 
^capacities and discussed problems i^ad^ini^ and^, 
their effects on effectiveness \Ce.g., Cicpurel, 1975f Corwin, 1970; ; Po<rnbush * 
Scott, 1975}* Corwin (1970),, for example, found that perceptions of a, 
'-, lack, of adnrta^strativ* backing,- conflict ov^er students,, and lack of authority . 

resulted -In lower teacher mferafffT No attempt was made to relate this to • 
^.student output measures, however. Bidwell and Kasarda (1975) found that " 
adBinistrative. intensity depressed median 'levels of achievement in their * 

of Iiw Colorado- school districts.' -Their explanation was that adminis- 
trative £ntensity\(as aeaauredrby staf f -teacher . r'atioa) merely diverts h 
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resources from teaching and other staff functions' related to teaching. ' t \ 
Their results have never been replicated and'the practical^, significance of 

• • \ . « 

■ the administrative intensity effect has been questioned (Alexander & Griffin, 
1975) . 

/ • - 

_ Barro (1970)"* probably comes the closest to a conceptualization of school 

• . ' . , . • «. 

. * system effectiveness in^terms of a managerial", process model. He recommends 

that § plaiming-progrsnniidng-budgeti^ method of jaanagement be implemented 
f a that is more output-justed than present systems; ■ Thi$ approaches presented' 
in an accountability framework such as that presented by Dyer (1970). Sim- 
ilarly, Radnor (1974) implicitly endorses a more systemsroriented, input- '** 
' t output model to replace the pervasive "management by exception" style i «s ' 
1$ other discussions of. educational management- (e^g., Yee, ^1973) 
systems -management models are presented wteLch, while somewhat similar to the 
otaag^rlal 1 . process aodels U.fc.; Cyert^S March, 19^3), appear to^be a closer 

* match with the systems-resource ifiodel,* discussld above (e.g., Georgopoulbs & Tan- 
; ; enbaiau 1957).' The managerial process> motfel iv hovevery more focused on in- 

. There is an increasing^interest in the importance of educational manage- * 
. merit toxr traditianaI>Qutput measures / as evidenced hy th* attempts to improve 

• ^ selection ^rocedurfes. for school administrators and principals. For/ example, 

■ « the National Association <?f Secondary school 'Principals has* developed a com-.. ■» 

•.prehensive assessment center to ^a•id- in- t&e. selection ofi-princASls and assii- . * * 
•> , tant principals '.(Hersey, -1977)\ .The program attempts tp. identify performance 
^ in the- assessment center thatr is related tb *high performance -as a dmi nistrators. ' " 
-v.- /A-4 ls ^ nc1 ? ±on » howvet/.mniit.'he>drawn a"t this potet^between managertal behaWor,^ ^ 
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performance; and effectiveness.- \ Campbell, Dunnette, Lawler and Weick (1970) 
- state that behavior" Is simply" what people do in the course of working^ e.g., 
•dictating a letter, or directing a "subordinate, etc.), while performance is 
b&avior that Has been evaluated (measured) in terms, of its contribution to 
the goals of the organisation. Finally, effectiveness refers to .some over- 

all index of organizational qutcomes\or which' an* individual is at least 

<■ • • ' • X_ . \ ■ 

partially responsible, such as achievement test scores, teacher* satisfaction, 
turnover, etc. ' 

Since the measure of managerial effectiveness is one or more steps ' 
removed from what ,the individual' actually does,, managerial performance is . 
likeljr to bl more. easily predictable than managerial effectiveness, as per-' 
formancfi- depends ddre.ctly upon managerial) behavior and-^s not a' function of 
-additional ►factors not 'under- the control of the indivkual (e.g., s>cioecon- 




pale 'level of students) .' "Preliminary results from the -NASSP assessment • 
center research supports fthfs position. ^'Therefore, it Should -be pointed 
out that a number of criterion measures that have^been used in the past to 
•predict school administrator performance . have prov^^tone insensitive to 
actual measured effectiveness due, to situational p? moderating variables ' . 

J ' * « * • , 

that can -affect effectiveness (e.g.," <#ieman,. 1972) . Additionally', the mana- 

'* . ' • ' ' • • \ 

ger's job is multifaceted (Gbis.elli> 1956). such that different managerial 

. behaviors may result in the *same" managerial performance rating. ^Also, a 

^particular managerial behavior may be evaluated as being hignly effective 

According to one; criterion, yet ineffective using ."another standard. See, 
•.for example," Bashers' (1972> discission of: conflicting administrativt goals - 

in education. The question we need to aslc, in terms of the" educator-manager, 
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as di^uaaed. by ^Campbell et a}.. (1970), is: ( 

, eke varieties or combinations of ^organizational circum- 

stances, personal characteristics, and behavior patterns that 
are likely td be perceived as effective inanagS&s? * 
^ Predictably/ tie next /wes€iori' would be: tfiat/is, it that is perceived, 
.as being "effective" management in education? England (19,66, 1967) in sur- 
• . iyeying. more than 1000 managers throughout the country, determined the goals 
that were perceived as being both/important and highly indicative of success- 
Eul .managing. Topping -the list were the objectives of organizational effi- 
ciency, high productivity and. profit maximization. Therefore, it is reasbn- 
able to define effective management in terms of organizational outcomes * 

{Seashore^ '&*Yuchtman, 1967):' ' '* 

<• \ , ; . ' ,-° ■ • ■ . v - . * ' 

' ^e*' define affective managerial job behavior as any set of v 

f \ . - ■ ' ' ■ . '*, 

managerial actions' believed be optisial for identifying, 
assimilating and .utilizing both internal J^and external resources 
toward sustaining, over .the long term, functioning of the^ organi- 
sational unit for which, a manager has some- degree of responsi- * * 
. biiity. (p. 344). '"\ • s , . , .. 

1 Effective managers, then,", optimize material, human, and • financial- resources 
» in sustaining the operation, of 'the organization.''' This operational definition 
relieves us of the\evalua.tion of traits thWare generally usee & describe 

^the successful or unsuccessful administratorrmanager and allows 'us to con- 

i ; . ' ■ ' . ■ - ». • ."'"'• 

' ] ce ^ trate 011 the tasks a^ hand .q Unfortunately, .in the educational context * 

♦there is .little empirical support for \a principal performance-educational 



outcome relationship. 
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' S '^ Uf l f 1967 ^ lists three' methods commonly used to study, what managers^ 

x ~i'<Zf- «"* '* ' ■ ,\ „ * 

do on^ their; Jobs: An observer may record what a manager does, the manager . ' 

' i tJ s. • * X 

may. lceep his own records or diary of his activities during a workday, or the' 

manager may be asked merely to estimate how he spends his time, using a pre- , P 

■ pared checklist of job duties or behavioirs. Numerous studie|^a^e utilized ' \ • 

these approaches, with varying but compatible results (Burns, 1957; Carlson, 

1951;' Home & Lupton, 1965,) . One of the ^rlies't job ^description checklists 

used to delineate the responsibilities of ,man^gerial\pef sonnel was reported 

by Guion (1953); Cluster analysis resulted in five arelb^f responsibility, ■ 

namely: 1) labor relations; 2) jnethods. and rates; "3J( maintenance of records; ' • ' ' , 

4) \ personnel .selebtion and placement; and # 5) meeting! and coping with day to / 

day operational problems as they arise. These resplts -closely- match the » \ 

results of job analysis of school administrators (e.g., Hersey; 1977; Yee, 

1975). • . - . ' \ , 

' / * * * ' * ' 

■■■ Another approach to description involves behavior sampling in which 
» ' ' . '» « 

^he type of activity involved in at t random intervals during the day is 

recorded. While mis approaches beefi used to infer the determinants of ■ .* "* 

"managerial effectiveness (Kelly," 1964), b'Neil and Kubany (1959) 'were able °" 

' to conclude from their research that tjne mechanistic, recording of jpb ac-' . ' .'" 

Itivitiej is incapable of ' Irevealiifr crucial differences between more and less ''. 

effective foremen:. Thus,:., for, the practitioner, the utility of this approach . 

in ■easuring effective administrative performance is; questionably. , ' 

lie critical liacident method ,deveioped^by Flanagan {^954) is» now« 



tever, 



.^more^romising technique for samplingv administrative behavior. This 

• - v.- »: . ■ . X e >s ■ , •* ^ \- , . . ^ 

• approach- requires ; reports, by qualified oWrrers of' the things that managers' 
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,} ' .... , 

do that^are especially effective or' ineffective in accpmj|shing parts of . ' 
jobs^ After a number of such , behavioral incidents are. collected,* the ab-1 
stracted categorized incidents are, combined to form a composite picture of 

O 

job essentials. With 'continuous recording and importing of critical incidents,' 

< . . , • *. 

**** techdtque can reveal the. dynamic attributes of a particular managerial 

j . job, and since it focuses on managerial performance , i.e.«what the manager 

actually dois, -can be expected to yield' behavioral information uncomplfcatfed 

'by situational variables. Several investigator? (Anderson & Nilsson, 1964; 

Kay, 1959;. Williams, 1956) have used this to advantage, denujtstrating a* high .. 

degree of inter-rater reliability/ in developing nonambiguous category defi-. ' 

* . ■ ■ 

nitions, based on critical incidents. In seeking to establish the 'reliability 

'.>'-. 

of incident classification and organization, Smith and Kendall (1963) sug- 
gested that behavioral incidents be 'retranslated those actually using the 

/ tt » » • «- ■ ■. : . ' ' ' 

■ scale to determine those /incidents that, can be reliably "assigned to a partic- 

ular dtuwTiftio na^ category, while eliminating- statements and dimensions that 

r . * 

* " - : " 

*; fa±1 t0 delineate highly specific and non-ambiguous - job behaviors that can 

^ be reliably used to! develop a final set of job specific behavioral scales. 

■'•j. Bernardin and Smith (1981) have, argued the approach has. potential for' alle- 

vlating common errors In performance measurement. 

In the educational literature no studies lould be, found which used 

critical incident methodology, retransiati^n, or detailed pbsefvatlOTa^pro* '* 
v f ' * * - t . ' * - ' 

cedures 50 identify ■ critic^ taak components for the educational administra- 

tor • ^/While^ these approaches ate certainly 'improvements over any. trait- 

. oriented a»aaurem*fft of managerial individual . differences , , there avk no ■ 

• *\ guarVattesJthat: such' ref ineS measurement strategies will lead,/to the 

ERJC: : V . - V;^" v f 8j9 \: • : ; . . 
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V * • 

establishment of a stronger relajfionship between edutotor-manageme^ per- 

formance and* outcome measures such as achievement test data.' Certainly we - 

• » *' . ' 

can predict' a better chance for significant relationships between effective- 

. neas administrator or principal managerial .parameters as measured above 
' thari withT characteristics such as race,* age, tenure; and salary that. have 
• beefclused most' frequently in the past. " 

Gross and Herriott (1965)^ developed the ''Executive Professional Lea- ■ 0 
dership" (EPL) questionnaire for elementary school principals. • While "the 
measure was hot b^sed on any oi the .methodologies discussed above in , * 
describing the 1 manager-principals » job, scores on the EPL were found to be 
related tp -teacher morale, teacher performance 'ratings, and student learning". 
•Hilfiker (1969) found that' scores on the EPL correlated positively with 
perceived levels of social support' .and' system i^ovati^enej^j . Teachers were' 
/ ^asked on the EPL ^to indicate the extent to which their principals engaged 
in activities': such as: Tbakes teacher f g meeting 'a valuable educational 
ac*L^ty $ Y p &*&ts teacher^ as professional' workers";. "has constructive sug- 
gestiotte -to offer teachers in dealing with their problems." T 
\ Another measure that attempts to assess the behavior of a principal is 
the profile of a School' (?0S; Idlcart, 1978, see below). In research with \J\~ 
the P<jS, .one of the factors derived In factor analysis .was- labelled "princi- 0** 
pal leadership" by Mlskel et al. (1979) . °The auflhors. stated that 



- i 



descritfed' the principal's behavior in terms ef supportiveness,*}wor] 
tion^^gdal^-eaphasi?, and interaction facilitation. The focus- of the* _^ 

•• "J.k:... .. . . 77 .... .. i* • .. 77" , 

1 




was w'^e principal-teacher level of interaction, For example ^ one of. the 
..•••.'*■' •• » — ■ . • 

~" '•■ it*B» waa "how often dp you see jour principal's oehavior as friendly and. 

:: •■■ , : • . '.' . v 1 % ' ■ 
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supportive?" Results from the Miskel et al# study indicated "principal 
leadership" was the best predictor of teacher loyalty to) the organization 

and teacher satisfaction. . s, . , 

• • — "*'.;••'. - . > 

. The Leader Behavior Description QuestionnaireV(LBJ)Q) is an. established 
method for. describing the behavior of leaders. While there are no published 
^studies relating LBDQ scores of principals to effectiveness measures, Halpin 
<1956) used" the LBDQ in a study of school superintendents! Respondents 
were asked to cjjpLete the LBDQ in two" ways: first, according to their per- 
ceptions of the- superintendent's actual behavior and second, baled on their 
expectations on how the superintendents- should behave. Halpin, found large' 

discrepancies between the actual and the ideal perceptions of the superin- 

»' • - * .- _ o • 

tendents bfchavior*. . Such/iscrepancies were -found to be negatively correlated 

• • • 

with teacher satisfaction. Similar results' have beemfound In other research 
relating^school superintendent behavior, to teacher satisfaction (e.g., Bidwell, 
1965; ERIC, 1973;' Guba & Bidwell, 1957). 

It is apparent that managerial process variables for .school administrators 
have been shown to be reliably related to several of the "soft" -criteria used 
fcp assess organizational effectiveness (e.g., teacher satisfaction and loyal- 
ty) . - However, few. studies have established a link between managerial behavior" 
and- any llhatd" criteria ;3tah as .e*^iency or student outcomes. Therefore, 
for the presen^ r - the practitioner ks cautioned not to managerial process"^ 
Variables as direct and unequivocal ' indices of school, system effectiveness'. ' 

. * * •«*»/.. A 

; If - pursued , ^ research imto.the; relationship between managerial behavior and 
per^ormanoe in- schools ^should shed some light as to th4 utlity of this poten- 
tial^ fruitful^pproach. „ 



- • I-"-- ,-- r ■ > 
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The Organizational Development Model ' \ 

The Organizational Development (OD) model views effectiveness in terms 
0f.tfhe organization's problem-solving and renewal capabilities (Cunningham, 
1977),' Utilizing the knowledge and intervention techniques of the behavioral 
sciences, this, mo^flel .attempts to shape 'the organizationalj structure 
climate siich that the individual's ability' to satisfy growth needs is W- 

mized. It is 'only when the potential of each member; is . fully* realized that' 

— \ - * 

the organization .can be Maximally effective. 
• • OD has been called a normative model because i f attemp ts to prescribe 

the requisite .conditions] under which an organization will be effective * 

. ■ • • * » 

(Steers* J976>. These condition! would includes 1} beings aware', of, open 
to, and. reactive to change: 2) searching for new methods and forms of or- 
ganizing; 3) having an optimistic view of its members - self-actualizing and • 
trussing; 4) seeking, to insure the satisfaction of its members since they 
are ^th^ reason for the v organization's existence; 5). having open communication; 
» J) confronting ani dealing with conflict directly without personal ' - 
. -references . » t . » ' . \ 

. J ' ■ • • ^ 

OD", as can be seen, has to . do with ItheJ^anj component of the organiza- 



tion. It s'haJes many features with "She managerial process model just des- > 
i > ' I % * , i 

: cribed. Both models examine the behaviors of individuals in organizations, 

and both models focus 4 on the individual's perceptions -of and reactions to 



the managerial processes operating,. Furthermore, 'both asspme that im^rov^e-*- 
««t^ln.th« informal organization' will resuit in a more effect! ve* organiza- ' 

„tion (Cunningham, 1977). However, unlike , other system approaches, OD seldom 

- ' ' ..it <■ * 

mentions goal outcomes.' If such things as profit and -turnover are mentioned 

». - , ■ . 
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at all, it is in & fairly unsystematic way and only after much discussion 
about such employee-oriented factors as increased individual openness, 
tetter communication, grater individ&al^self-actualization, ajid other 
indicators of what, is "considered to be V,"heaTthy sj&tem (Campbell, 19741 

from the individuals perspective/ No ^mention, however, is made, of 'the 

^ fa 

students , parents , or community' s perspective*, - . 

The OD model only assumes t£at if an organization (e.g.„ school 

' system) can achieve the. list' of end states that j^ef^ne a healthy syst?mY 

• ' " ' I 

(e.g.,. Beckhard, 1969), it will be effective as an organization and will 

be optimally equipped !to carry out its mission (s) . - however, the model' 

makes no mention of what the mission i^, or how the organization attempts 

• to achieve it. . , / 

Typical of an OD model is the attempt to prescribe the requisite con- 

• ditions under which an organization! will be I effective, without mention of 

* <" I -f ■ » r •» .... : 



a rational or empijLc^L defense of tlfe criteria as true measures of ef f ec- * , 

'.. ' • ' 1 * ' 

• Xiveness. The OD model assumes organizational effectiveness without ever 1 

me*axiring*it. • 

I- ' • i ■ * ' > 

The OD mo4el is related conceptually and empirically to the literature 

« * 

on organizational climate in this respect. Organizational climate has been 

1 ' v . X , • 

described as the result^ of the transaction between individual members, with 

their individual needs, abilities and goals, and the organizational structure 

(Campbell.et al., 1974; Schneider, 1980). It reflects the strength of the ' 

prevalent values, norms, behaviors and attitudes of the organization. 0rgan-| \ 

i^ati<Jnal climate* has been studied rather extensively, in the field of educa- 

|tion^ Nuinerous climate measures have been developed for educational enyiron- \ 
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^ ceptions . of typical peer gro"up behavior and the remaining four "scales ^assess 
v l perceptions of the behavior q*£ principals, in their interactions with^ teachers . 
Besults from the OCDQ are interpreted in reference to an* "Openness vs. Con- 
trolled" continuum. Theoretically^ any. school can be "placed on such a con- 
tinuum depending on its characteristip pattern of internal social behaviors. 

The practical importance .of climate research in education has suffered 

* * * * * -» 

• however, because i# in general it has not attempted to measure Ifchool sys*^ 
effectiveness. Much -like the OD model, it only assumes- effectiveness. Fur- 

- thennore, there has been virtually no attempt to relate the limited research 
on school, climates *tb a trast^rese^ch on organizational climate (ScSgmeider, 

i980 c ). # ; . ' 

« • . ' • \ •/ A , 

Radnor (1974) has discussed early applications (if OD in Education and 

finds that; fotf the most part, schools "do not perceive any need for improvement 

i4 organisational functioning. Numerous examples^ of ill-fated*, QD interven- 



tions can be cited which started in a climate .where participants did^ not 



perceive a great need for change. These studies most often use /employee ^ 



• \ 



ments, the most frequently used being p tern's College Characteristics' Index . 
Pace ' s Coltege an d University Environment Scales . Aston and Holland V Environ- 
mental Assessment Technique.- Pervin's Transactional' Analysis of 'Personality 
and Environment, and Halpin and Croft's Organizational Climate Description * 
Questionnaire (.Campbell et al., 1974). The Organisational -Climate Descrip-. 
tion Questionnaire (OCDQ) (Halpiri & Crpft*, ( i962) is one 'of the few climate 
measures that has looked -specifically at the*.plimate of elementary schools. 
This • instrument measures responses to descriptive ^statements about peer 
(teacher) ancTprincipal behavior. Four fcf its eight scalesr^ tap teacher per- 
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attitudinal measures to assess change as a function of the intervention. 

Thus, not oniy is the OD approach plagued' by measurement problems in terms 

of objectives but also ip terms- of perceived nefeds for such an approach. 

. * » 
One study that fits into the "classical, OD framework found a 'significant 

relationship between perceptions of "openness" in the school and job, satis- 
faction of the teachers (DiCaprlo, 1974). 'sfuch data serves as the basis ' 

of some type of OD intervention to facilitate greater "openness" in certain 

* 

schools. However, as stated ekrlier, there is a paucity of data that re- ■ 

r * * 

lates teacher attitudinal measures such as job' satisfaction to an^ effective- 
ness measures such as student, achievement, ^eachejfc turnover, absenteeism, 



etc. 



While there are differences^ i& specific characteristics of organizations 
theorists define al "healt±yl^systems, there ar^ three general assump 
tions underlying mostiOD approaches.. The most important assumption concerns 
the general ftatureof man and is best represented by McGregor's Theory Y 
(McGregor, 1960) . This philosophy of management states that the expenditure 
of physical and mental effort is as natural as play or rest and that work 
is a -source of high, satisfaction. Also, people- will exercise self-control, 
and*sf If -direction, in the service of objectives to whicfi^they are. commit ted. 
The secorid assumption la tfyat organizations must anticipate and cope with *a 
changing ^yorld^ Thus, a rigid, functional bureaucracy is outmoded dn this 
dynamic environment (Bennis, 1969). The final assumption implicit in the 
^ literature on OD is^hat^rganizafci^^ primarily for the benefit of * 

members. of\he organisations (Campbell et-ali, 197*4): dne example ^ 
ope^ationalization of these assumptions is the work of Staunfield (1976) . 




V " ' v 



* 
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He studied the effects of te*cher-admiS^strator' interactions on elementary* 
; reading achievement. His major hypothesis was tha^ the greater the partsir 
, cipatipn by the administrator in program planning and r ^ f supporting" teachers 
the greater the outcomes. The approach is^a close matchf to French f s (1972) 
description of a "healthy" system, characterized by high trust and support 
across' organizational levels, ,opeir conaiunicttion, group responsibility ^br 
design and planning, confrontation* rathe 3^ than avoidance of problSJ and 
frequent synergistic solutions. Staunfield fpund that such a climate w^s 




in fact significantly related to f reading achievement. „ , 

Another example of an OD approach to education is Mar&rosian (1975), 



/^who reflects the theoretical work of Bennis (1969). Bsnnis' characteristics' 
for an effective organization are: * dfecision-making located* close -to the 

"sources of information; - a reward system* linked to the achievement of organi- 
zational goals? -and a support system built into ther vertical, organizational 

i hierarchy. Mardirosian fou&d that teachers from higher 'achieving schools ii 

/: ' . . - A * 

the st^te of California perceived stronger support systems and closer rela-, 
tionships between rewards and goal attainment than teachers irom\the low^* 
achievement schools./ V' ' <. 

* 4 > * • ' , * 

A final example of a traditional OD orientation is the work gf Corwin 
.(1970), in a study oil educational effectiveness*, Eujfstqdt of organiza- 
tioiial conflict-in # high schools "is a vivid description of- aa ""unhealthy" 



.system &s defined by Bteckjiald* (1969) : conflicts avoided or supressed: 



c 



4psed communication channels^ no -concern for subordinate growth, ot develob- 
ment; and; no formal feedback systems for performance. Teachers in Corwin 4 s 
study indicated, that factors such £s peer incompetence, lack ^f ^upervisor^' 
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, support? and constricted authority had deleterious effects on their perfor- 
mance. As with most studies conducted in an OD perspective^ however, no 
actual performance or "effectiveness data were collected* , • 

* 

The major shortcoming, then, of the OD models discussed above as applied 
.to school systems is that they either assume or ignore a linkage Between OD 
goals and the more clearly defined, objective goals of school effectiveness 
such as student performance . These latter goals are the. very, reason for 
the school system's existence,, not the psychological 'growth? of organiza- 
tional members such as teachers, administrators, etc, A -useful model of 
school system' effectiveness must go beyond an assumption that school systems * 
a£e effective solely on the basis of teachers having "self-acj:ualized w , 
developed better communication skills, or higher levels of satisfaction. 
The model of ef fectiveness^must include both , clearly stated 'objectives and 
, the criteria^ta be t used in measuring these objectives: Models' of organize- 
tional development i^ude^neithet of these dimensions and are therefore not 
a'dequate^as jtadels pf school system effectiveness. 

The Likert-ISR Model 1% . * ' - 

• * < 

T^e Likert-ISR model of .organizatigttal effectiveness* (e.g. , Likert, 

• * • . • - i 

1967) can be classified as.an-fliHnddel-iar-fchat its .majortocus is the notion ^~ 

' '* / '* • ; ' • * 

*of shared power pv participation^ decision-making. Thus, there is overlap 

between the. Likert-ISR mod^l afttf the OD models promulgated by Bennis (1966), v 

* • » 

French (1972), Shein (1965)', and Beckh'ard (1969). The majtfr premise of the 

Likert-ISR' model is' that the closer die administration o^t school system is* 

to "System r4 lf , fche/mdre effective the system is viewed .to be. % System 4 is 

a democratic, participative group model-. All decisions are reached by group / 
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consensus, and all groups have "linking pins" (i.e., persons who hold ■ 

t * 

overlapping membership in groups) . "It is assumed that since* decisions are 

made by. group' consensus, all decisions will be 'fully accepted both overtly 

and covertly. Communication lines in System 4 are open and move freely 

f ■ , 

among and between all levels of the organisation, with little or no disto- 
r- 
tion or filtering of that information. Because fear or coercion are not 

used, attitudes are very positive. A climate of trust and openness is the - 
rule, not the exception. , \ 

In order to assess the extent to which a school system is participative 
in managerial style, fitter t (1978) developed the Profile of a School (POS). 
The POS consists of 10 questionnaires that are designed to record behavioral 
, information within the organization as seen from the various Revels 1 of the - 
organization (e.g., students, teachers, ^principal, superintendent, and parent). 

e * 

While the POS attempts to characterize' individual's overall attitude and 
.motivation, its primary concern is to record current behavi'or and organiza- 
tional practices, at the various levels of the 'organization. The variables " 
it attempts to measure are those "that have been found to be related to quality 

of performance in both school administration and business settings: leader- 

• 

ship, decision making,, problem solving, motivation, communlcationT^conrSct ™~ 
management, interaction, and the structure through which interaction occurs 
(Lttert, 1978).- With the POS ,- schools or school districts can be diagnosed 
as either. System 1 (authoritarian, non-participate) , System 1 (benevolent 
authoritarian) , System 3 ( consultative) or System 4 (fully participative) . * 

ileld research comparing System 4 schools with their* counterpart 
(System. 1) has been summarized in Table 3.* 
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s . Insert Table 3 about here 

" ' " 

£ few of -these studies have. correlated objective* data such as achievement' 

test scores w^th system classification and have found both higher achievement 

'test scores- for System 4 (Donlau* 1978; Gibson, 1974) and no relationship 

between managerial ityle an4 educational performance (Horsman, 1973) . There 

is, however, a considerable body of field research that does support the 

validity of the Like rt -I SB. model, as 'shown in Table 3. One limitation of 
'* t x \ ' 

most pf these studies is that the outcome measures have been "soft 1 ? ones, 

such as ;}ob satisfaction*, need satisfaction^ labor relations, morale, etc. ' 

_ * * * • 

The limitations of such "soft 1 ' criteria have been discussed previously. 
t The Likert-ISR model also fails like the other OD models in that it 
assumes that 'if participative managerial conditions exist,'* the 'school system 
will be effective. Stated differently, the Likert-ISR model proposes, in 
essence i that all a school system" need do to have an effective organization 
is to' have a System*4 oiganieation 'is- they define it. ' While' this reasoning 
is questionable in and bf itself; Likert and his associate's support this 
16gic with research thalt often uses only- one or two of the 10 POS scales 



developed Thus, the research' purporting to support the Likert-ISR model 

oftei^only gathers information at one or two levels of analysis (e.g., the 

i * * * 

teacher and the principal)' and yet Implications are made In terms °of the 

I ** * 

itotire sciw)<a system. Despite these limitations in the research, the 

* * t * • . , « 

♦Likert-ISR model 1 itself "Soes ha$e much to offer in terms of assessing the 

* * ' I' ' 
perceived effectiveness of v a school 'system. The PO§ can be used as a 
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diagnostic todl to assess the Internal state of the organization, and the 
Likert model can Suggest ways in which to^improve that internal organiza- 
/-^tional state. However, since organizational climate is not the "only 
determinant of organizational, effectiveness, the Xikert model is not 
sufficient in and of itself to assess organizational effectiveness. 

Conclusion - The Choice of a Model for School Systems 
It is our contention .that what the literature on organizational 4 effec- 
tiveness needs Iea$t*is another model of effectiveness. Rather , we-believe 
th£re are components of several x of the models discussed above that are- 
appropriate for school systems. The advantages and disadvantages of each 
of the models has been delineated above. ^ 

. The two models most supported by empirical research are the .management- 
.by-objectives' and the Likert-ISR models.. Both models hav6* problems when . 

applied to school Systems, Tfe believe thf» positive features of .these models , 
"•* \ '.. .*' * , * 

plus those of die other effectiveness models are best conceptualized- in a 

process model of ..effectiveness. / 

\Campbell et al. (1974) and Steers (1077K in -tfhe general context of 
oi^anizational effectiveness, and Madaus et al; (1980), in the" context of * 

s , 

iilidol-e£f ec civeness ,Tiave recommiSided mddeIi^o£~effectivfeness- with emphasis • 
on processes- related ta effectiveness. In ali three cases, the process models 
incorporate various\features of goal-denterfed and systemS-oriented models 1 , 

of effectiveness. Steers (1977), for example, delineates thfcee major dimen- 

' ■ * ' ■ ^^^^ 

sioxjs for his process model. These dimensions are: 1) goal optimdtzati^i;- ' 

* t • , ' ' - ' , "I 

2) a systems per spec* tivej' and 3) a behavioral emphasis. In refererite to 

* . ■ \ *• ■ / 

many of the goal r oriented approaches to effectiveness, he states |§s"essmenrs ' 
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. of an organization's successes or* failures- must be made with reference to 
the intentions for the organization rather than the value .judgments 'of the 
researchers.^However. Madaus.et al.. (1980) point out that such' "intentions 
' • (i.etf school objectives) are indefatigably linked to the value judgments 
of "those responsible for the school. Thus, only if some y conseusual agree- 
ment can be reached with regard to the "intentions", for schools can\bsoiute 
or relative comparisons be made with regard to school effectiveness: Whi|e 
Madaus et al. (1980), Bloom (1976) aid many others" agree that.the~process V of ' 
reaching such consensual agreement 'will Weed be 'difficult 1 ,* the majority ' 
also fe.el- the task is.' not insurmountable-. • Campbell et al^l974) '.present 
, an. excellent procedure for the development of task objectives bas'ed on. tie. " 
perspectives of all relevant cons'tituenciis. ' The adoption - of this procedure, 
. a varient ° f ^ e 'scaleU expectancies methodology from Smith and Kendall \ - ' 
(196$), would provide for an. operational d*efinitiori° of "consensual 'agree- 
•&a&Lt n a£ intentions and a documentation of, the differences in intentions as 

3 function; of the constituency.' Likert. r s (1978) j'Profile of a School" ' 
.'questionnaire has Sterns Related to -intentions from' the perspectives of board 
" members, principals, teachers, and students. . •» * • 

™ Steers U9//; also- strongly endorses the open systems ..theory of* organi- 
.C.zational effectiveness which -emphasizes ' the interaction of the organization 
with- the environment - . The major focus of this perspective is on the rela- " 
tionships^tween components 'both, inside and outside the organizations as 
: they affect the' organization. The discussion by Metfessel and' Michael '(1967}° 

in the context of colleges and universities is a good 'example of an 
. • - o* . . •' ■> 

system, goal-optimization model which also *as applications for/^lemehtary 



• * 

c 
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and secondary school systems. Program evaluation, they state, should in- 
volve members of the total school community such as lay individuals and 
groups, professional personnel, and students. Likewise, in incorporating 



an ojJen-systems perspective for school effectiveness, ^e^atilonships between 
constituencies representing the total school communities should also be 
recognized and, according to Steers (1977), should make: it easier for mana- 
gers to "... take decisive actions to t facilitate gdal attainment became of 
"their increased understand!^ of organizational dynamics" (1977, p. 177)4 
Thus,- Steer's .thinking reflects one of the major components of the managerial 
process model. " ~ ' - • 

The third dimension 0$ Steer's (1977) process" model emphasizes the role' 

of -behavior in affecting organizational performance. Steer's" states that 

if we are to gain a better understanding of thte' factors that explain effec- 

tiveness, It is critical* to first .gain "an understanding of the basic unit ' . 

pf analysis; that is, « the' behavior of t£e organization's members. It '±3 

this third .dimension that- is most of ten>„mis^Jng in the goal-oriented or 

systems-resource models.' 'As stated in the reviews' of the -specific models 

» * "* •"»*•*. • ' 

withiri the' go'al-oriented and systems- perspectives, there is generally little 

1 ' ' " ■ ' - ' ») • • '' - r . 

consideration given to -the "means" (i.e. f the behaviors) ' employed for. or- 

• » v 1 " **■ * 

. - t 0 4 m 

ganizational "end-stajtes" . While "this criticism is more appropriate for 
the .goal-oriented models (i.e., rational-goal, MBO, functional, and cost- 
ybenef^t), the, systems models are also generally -outcome-oriented, partic-* 
ularly the systems-resource and~ functional-structures models.' In fact, only' 
the managerial process mfcdei considers the "means" (i.e., managerial be-'^s*-' 
h^vior) as an important element- of the mqdel.- tftrfortunltely, <as rdiscuased* v 

.102-. ' • } . ■ : ' 
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above, there are few empirical studies of managerial behavior in school 



"systems', 



The greatest gap in the research on school effectiveness 'is in this 
general area", of human resource Behavior and perfqrmance. There are of 

course, a great many studies which -focus on teacher behavior and its rela- 

• » « , 0 t » 

1 ■ • 

tiou to certain stud^at variables. However, none of these studies consider' 
these* relationships in the context 'of school effectiveness. There is a need 
• to assess such input and output variablesN^ithin the framework of a process- 
oriented^ behaviorally-based model of effectiveness! Relationships between 
task objectives at the macro level, organizational' member behavior at the 
micro level, aftd outcome measures' such as efficiency (systems research) ! 
climate (functional-structures), morale (Likert-ISR) and student outcomes 
(MBO) should be" investigated. .: -. ^1 

There has been Very little research which has attempted to employ a" 
multivariate strategy. in order to study how the various school outcome meas- 
ures- interact. Also, with the exception of the studies on compensatory 
school p*ograms > , the use of static research? designs has precluded investiga- 
tions of the dynamic nature of the various" criteria employed in studies of 
school effectiveness and their relationships to various schpol inputs . The 
use of archival data in order to^ake. hypotheses about these relationships 
would certainly bfe an excellent first step in t£is regard., 

Human Res ource Process, Variables in. the Prc^ess Model . There wag • 
generally a lack of 'research in the area of^he human resotirces available 
t^school systematise., teachers, Principals, administratprs) <N and Human- ' 
resource policy. Studies that have investigated human resource variables 



\ 
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have concentrated on those that -are most easily retrievable such as years , • 
of ^education or experience, salary, and demographic background character- 
istics. A'process mddel of school effectiveness should incorporate factors 
pertaining! to- personnel selection, training, and evaluation procedures, • 
particularly for teachers and principals .* Based on a considerable amount 
" of research in these areas outside of education, we can hypothesis that 
some "process" variables in school administration are related to uncontam-- 
lnated measures of school effectiveness. ' For example, the extent to which 
a content-domain sampled, structured interview is used with trained, mul-' 
tipie assessors should be related" to more valid selection decisions at both", 
the teacher and principal levels (Dunnette & Borman, 1979) ) The type of 
formal performance feedback system established for teachers should be related 

* * *** ' * 

.to improvement -of teacher performance over time. The level of teacher job 
satisfaction should be related to both absenteeism arid, 1 to a lesser extent ', 
turnover^ The level bf-professionalism exemplified in! schools by ongoing 



training programs and teacher-principal interactions should be related to 
Improved teacher performance. * 

We believe the step -following the task objectives -procedure described- 
by Campbell et al. -(1974) in the refinement of a process model of school , 
effectiveness should be the development of a. questionnaire that assesses 
variables related to school personnel selection, training, arid evaluation 
P 0110 /*.. Such , a questionnaire should alsd include organizational climate, 
variables shown by Likert (1978) and- others"'6o be related to several out- 
come measures. As will be discussed below,- we believe the personnel pro- 
cess variables* will show, relatively little variance across school systems 
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at the present ,time. 

Madaus et al. (1980) discuss several other factors found to be related 
to hi^ier student outcomes in several studies. While there was considerable 
overlap with some of the climate variables discussed by Likert (1978), two 
important predictive variables were student perceptions of academic futility 
and teacher "push" (a,.g., Brookover, Schweitzer, Schneider, Beady, Flood & 
Wisenbaker, 1978). Brookover et al. (1978) reported that the social-psycho-* 
logical and normative variables, based on these measures of climate, con tri- 
buted close to 80Z of the variance in mean school achievement <when such 
variables are entered first in a regression analysis. Madaus et al. (1980)' 

also cite several other studies from their own work outside of the United 

* 1 - . » 

States-to support the importance of . such climate variables. Items related 
' to these variables would thus be appropriate for the "process" question- 
nair8. - 

T|iis "process? questionnaire shoiild be. Wed on the results of the 
task objectives prdcedure and incorporate the salient features of the - 
goal-orieuted and systems-resource. models discussed dbove. r Efforts 



• * 
should bie made to theoretically link these process variables to out- 



come measures frequently used in the ed^tiona!' literature. Be'fore an 
empirical study relating the "process" responses to outcome measures is 
undertaken, however,' major considerations must be given to the important 
•issues of research design ^and data aggregation* The next section will 
iJbTitlque research designs that^have been employed" to investigate vari- 
ables related^ to school effectiveness. 
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Research Designs in Studies of School Effectiveness- j . 

While there is near unanimous agreement that, among school related * 
variables* teaching quality is the best predictor- of student 'outcomes, no 
studies could be found with an appropriate design for investigating the 
effects o£-teachers over a period of time Jonger than one year, .Several 
studies ^. discussed above, have fcjund moderate relationships between teacher 
characteristics and measures 1 of student achievement (e.g., Rosenshirie & 
Furst, 1971). However, attempts to study the effects of schooling \at a 
higher level of aggregation (e.g.,* school^" district,, or state level) Tiave 
made no provisions, for the fact that individual teacher effects' will be 
diluted in. any such analysis*. Consider, for example, t£e following research 

scenario: pupils in grades 3, 6, and 9 ^e tested for achievement and their ^ 

• » 

scores are aggregated over teachers and schools to the system level. The 
scores are then porrelated with, a great mpher of potential predictors of / 
student. achievement. The result* reveal trivial effects for variables re- 

lated to the school^, including those of the Classroom teacher. BaseH on this 

» «» * * ■ * * 

type of research, the conclusion is drawn that '^school brings little to bear 
upon a child's achievement that is independent of his background <and general " 

===== ; = " - • / 

1 social context" (Coleman et al., 1966, p<? J325) or^ "schooling does relatively 
little of what it always claimed to do - foster the cognitive abilities of 
- students and thus assure them a productive niche in the economy" (Levine $ 
Bane, 1975, p. 19). While Madaus e^al. (1980) have done an excellent jcfb 
of reviewing the problems in this type o£ design* and "&e inferences draxm 
. from research with it, the impact of the data aggregationifcthod on teacher 
effects should be emphasized. Roberts, Hulin,*and Rousseau (1978) statue 
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that if one is going to aggregate data prior to. data"analysis/ the interpret 
; + +• ' • * . 

\ -tation of the meaning of the data should^be clear prior to' aggregation. 

* - . 

Given the dire conclusions drawn from aggregated 'data analysis such as in 
Coleman et -al % '(1966) and Jencks et al. (1972),, it is clear -there was little 
consideration of interpretation vis a 1 vis aggregation. ' 

' The ideal study ^'investigate* teacher effects would be something like 
f the following: X) using a valid .performance assessment method r , teachers are 1 
rank ordered or rated on several important dimensions of effectiveness within 
grade levels; 2) criteria are selected that have construct validity for school, 
effectiveness and conceptual similarity with the dimensions of teacher effec- 
tiveness (e.g., -student achievement and teacher "achievement-orientation" 
or student motivation and teacher "support facilitation"); 3) a large group 
of studfents (n^> 600) is randomly assigned or 'matched '(based *on background 
characteristics) to teachers who have been identified as "highly effective" ' 
on the dimensions^of effectiveness or to teachers identified as "less than 
highly effective" (the ideal design 1 would identify teachers of both high 
and low effectiveness on the dimensions) . Assuming we can identify teacher 

grotfps pf both- high and low effectiveness on two dimensions, our longitu- 

. » *•«.•' 
• dinal design j;ould be something like a 2 x 2 x 6 (grade levels) where we 

would study individual students ■ over a six .yea* period; 4) students are 

assessed on the^ criteria over gyade levels with greater effects predicted 

over time as a function of teacher effectiveness. 

• 9 , * 

\ ' , » # „ . " - * 

Before we are locked up and put away, let us~~emphasize that this "ideal" 

* ... * . * 

design hps been presented for illustrative purposes only, ■ We only offer it 

f * ' 

as a basis for comparison to the designs that.have been used in the past in 
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o^der to f \tease out" the effects of teacher performance or other school-re- 
plated variables that do not affect all students equally. Based on the four- 

steps in^the "ideal? design,, let us make !some • general comments about titei 
, quality of the school effects research we have reviewed: * 
• x 1% Performance assessment ^procedures for teacher effects are -crude. 

For the most part, criteria used to operationalize tocher performance has 

been primitive with little consideration of research implications Ntn* the 

area of performance assessment. The majority of studies reviewed ^used trait- 
% leased, supervisory' ratings of teacher performance, a method replete with ^ 

potential for error (Bloom, 1976). T&e nftich fewer number of studi<& that 
•investigated principal or administrator performance are aiso generally guilty 

Qf faulty methodology in this, same respect. 

Other; studies- have employed measurement strategies with even lfess* poten- 
* * ^ ' * • 

tial- for validity. Coleman -et'al. (1966), for example, used teacher verbal 

ability «as a predictor of student , aptitude . While there 'vas some evidence 

that teachers T * verbal ability was related to achievement/ the variance 

accounted for by this predictor was' low. , This does not strike us. as surprising. 

An analogy in tf^e measurement of * managerial, performance would be to use height 

as the measure of success. Several studies have documented Oh* correlation 

•between height and nfenagerial 'performance sa why not just use .height as the ~ 

measure pf success- rather than, bothering with the cumbersome task of measuring. 

performance. The simple answer is that height is not a measure of performance 

and neither is. the verbal ability "'of. teachers. Both variables are »only cor- • : 

relates of the construct^ under study and since their respective porrelations - 

with performance in no yay approach those of acffeptable reliability coefficients 
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they should not serve as replacements for the variables' we wish to study f , 
Of course, given the sample size (645,000> students and 60,000 teachers) 
and time constraints for. the, Colemaji et.al. (1966) study, it is understand- 
ably why a verbal ability meas^e^s used as a surrogate measure of teaching 
quality. However, it is equally understandable why such teacher effects 

contributed so little to the prediqtive equation. The major point of this 

» * 

argument is that if your interest is teacher effects, efforts should be made s 
to maximize the predictive potential of these- effects with sound measurement 
strategies (cf., Rosenshine & Furst, 1971). 

f « 

2. The mpst common criterion for the assessment of school effectiveness 
has been scores <on standardized tests (Averch et al.,, 1972; Madaus et al., 
1980). Cooley. and Lohnes (1976) have taken the.position that general verbal 
and nonverbal ability tests are the preferable measures of school effective- 
ness for both primary and secondary 4 levels because the "intellectual factor 11 
measured. Qn such tests is* the most common across schools an£ grade • levels • 
Coleman et al. (1966) also argued* for .the-preference of verbal and non-verbal 

ability tests. . * % \ ' 

* 

The is^ue of the appropriateness of various', outcome measures for studies 
k . - * * • • 

in school effectiyenes^ is best concep.tuaHzed as an issue of measurement 

* -JL, * » 

validity. ' Validity in the context of school effectivenesses the extent to 

which outcome measures correspond to actual effectiveness levels for school 

systems. Just as when we are interpreting a test we*' wish to make an inference 

about the degree $6 &hiah a person possesses a certain trait or quality , 

measured by the test 4 so also in interpreting effectiveness data, we wish to 

infer that a'school system's actual level of effectiveness on a dimension is 
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'reflected by the effectiveness data. 

The traditional types of validity are mentioned in virtually every te^i' 
in educational testing and differential psychology and <are discussed in 

. # 

detail in the Uniform Guidelines on Employee Selection Procedures « the 
Standards for Educational and Psychological Tests (American Psychological 
Association, 1974), and the Principles for the Validation and Use of Per- * 
sonnel Selection Procedures, Second Edition (APA, Division 14, 1980). Iri 
terms of school "effectiveness 11 , "construct validity" is the most appropriate 
for the definition of validity given above (James, 1973) • There can be no 
question, howeVer, that features of content atid criterion-related validity 
are also applicable. In fact, we are of the position that the distinctions 
that, have been drawn between the difi^erent types Of validities result in an 
oversimplification ~of the meaning^fr^^aity, leading to numerous reports 
of "one-shot" validation processes (punnette & Borman, 1979) . The APA 
Standards state that "a thorough understanding of validity may require many 
investigations" (APA Standards, 1974; p. 25). This statement probably best 
sums up our position on the validity of school effectiveness data. The 

i 

term "construct validity" probably best captures this position (Campbell, . 
1'9?6)/ . % 

Construct validity has been defined as the degree to which variability 
in a measure ia/,a function of variability in some underlying construct. ' 
Thus, in the scHool effectiveness context, variability in the measures of 
school ^effectiveness should be a function of the variability of the actual 
effectiveness levels of. thofee schools . The same 'definition of construct 
validity can be applied to > teacher effectiveness by simply replacing the 

- ' 110 
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word "school" with the word' "teacher*. . What should be underscored In 'the 
definition qf validity is the notion of inference . . Validity; does not refer 
to a specific measurement strategy. For example % it should never fV be* said 
that MBO is; a valid tecnnique for* measuring school effectiveness, implying 
that validity' is a constant across users, uses, and situations. Rather, the 
inferences '.made* from the use of MBO data cau*be said to be valid or invalid 
based on the e^dence presented. Cronbach (1971) put it best when*he*said 
u . ; . one validates not a test, but an interpretation of data arising" from a 
specified procedure . . . Because every interpretation has its ofrn degree of 
validity, one can neve^ reach the simple conclusion that a particular test 
is valid^ * , • * 

The, evidence presented ttf support? inferences, of validity can and should 

be from many different sources and based' on methodologies that have been 

* * ,c> » 

recommended for content, criterion-related, and const:r\ict validity. ' It is 

thus important to conduct criterion-related validity studies where possible, 

ahd to use content-oriented domain sampling in order to be able to justify a 

conclusion that. effectiveness data are valid. • 

Research on school effectiveness has in general ignored the issue of 

content-domain sampling and concentrated instead on criterion-related validity 

studies using ability tests scores as 'the criterion. Madaus et al. (1980)' 

make convincing arguments that the generally poor criterion-related validities 

are at le^st partially a function of the lack of construct validity* for the 

-ability tests. They state that "... schools have a whole host of objectives » 

in the cognitive area which are not represented in attest of general ability 

** 

... It seems .curious -to look for differences between schopls on something 
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that is only incidentally taught while ignoring the possible differential . 
success on material thai; is more specific to school curricula" (1980, p. 124). 
* 3. Step 'three in the "ideal" study presented above had to :do with ' 
experimental design and sample size* The ''ideal" design was presented \£hat 
would be most sensitive to teacher effects. Our review of the literature on 
.school effectiveness reVealed no studies employing designs that approxi- 
mated the "ideal" and, with a few notable exceptions, sample-sizes that 
fe&derfed most: research designs virtually "powerless" to refute the null ' 

/ hypothesis* On the issue* of sample sizes, a ^lassie article by Schmidt, 

• ^ * . * 

i Hunter, and tfrry-(1976) documented the statistical power of test validation 
research given certain sample sizes* They were able to show that giv^i the* , 
common problems of range restriction in the criterion and criterion unfelia- 
bility, most -researchers ^grossly underestimated the number of subjects 
needed to detect^ true difference^. Such a problem may also have accounted ' 
for many of the dismal results for school effects reported in the literature. 
With regard to the issue of research design, numerous examples of quasi-' 
experiments (Campbell & Stanley, 1966) were found In assessments of compen- 
satory programs such as«Head Start (e.g., Cicirelli, 1970). However, no 

* 

examples of quasi-experimerits that approximate the "ideal" design* above 
cotiid be fo|md for hon-compensatory schooling. *F6r example, it would be 
possible toj -compile criteria data on teachers and, based on ranking or ratings 
of performance, group students based on the number of "highly effective" 
versus "less than highly effective" teachers they were assigned through a 
designated grade level. This quasi-design would resemble the^straight "ideal" 
experiment with the e^cepticgi th&t subjects would be "randomly" assigned to 
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a number. -of- Highly -effective and less effective, teachers over the- six year 
period Predictions could then be^made based on the numtfer of "highly 
effective" versus "les^s than, highly effective" taachers ('between dimensions) 
and the effects of .different distributions of teaching quality ovef^ the six 
yea* period.- *For example, the effects of where in the six year period the 
students received the "highly effective teaching" could be investigated. 

t ^ lis quasi-experimental design would not be as sensitive as the 
w "ideal" design presented above, assuming there is reliable variance in the 
pred^ctpr^ (i.e., a good range in the number of highly effective teachers) 
across students, such ar design should facilitate a reasonably sensitive, tdst 
.of the relationship between teacher characteristics and school outcomes, 

providing consistent longitudinal ojitc&me data are .available on the students 

f - j 

(e.g., Project Talen't data; -Flanagan & Cooley, 1966). Madaus et al-. (1980) 

discuss some of* the drawbacks to longitudinal quasi-experimentation, most 

v • ♦ , 

having to do with the inability to assign students to groups (see also 

Marco, 'Murphy, & Quirk, 1976) . The fact ,that the researcher cannot select 
the criterion measures could' also "seriously affect the study !s sensitivity 
to true' differences. * 

'Returning to the "ideal" design for a moment, perhaps a socially accept- 
able design that would be more sensitive than the qua&i-design presented 
' above is one in wljich students are randomly selected to all. "highly. effec- 
tive" teachers with comparisons cjade between this group an&~those students 
.who had exposure to less than all. "highly effective" teachers.. This type 
of . quasi-experiment approximates the normal class assignment situation and 
thus would not disrupt the educational process. Also, and given the points 
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raised above about the criteria, a critical consideration- is the fact that - 
such a design would again allow the experimenter to select the most' construct 
valid ^outcome measures for t s£udy in the" longitudinal design. 

♦ The typical study of school effectiveness divides the/criterion variance 
•into within 'and between school variance. Main effects '"in 'this type of - 
analysis for characteristics of teachers or principals are eSrldent when ' 
there are greater differences across Schools at school districts than within 
such aggregations. With regard to teacher effectj^there is an implicit 
assumption that there are factors at the school, district, 'or strate level.- 
that somehow distinguish teaching quality.* For -example, might some school 

districts, have more valid selection systems ox lower selection ratios (i.e.,, 

, ' • \ » *« « * 

f a lower* ratio of applicants to openings) ? • Might dome school districts spend" 

\ ^ , * ♦ • * . • * « * 

irrelatively greater amount of money training teachers to be more effective? 
Als^, might teachers of potentially higher quality select certain school ' 
districts over others? ^ Similar questions can be asked of principal or ad- 
' minis trator characteristics 1 . Based on our review of the literature, personnel 

Selection \and training in education is generally uniform across schools, 

\ ■ " 

districts and other levels q£ aggregation. In other words, thefe is little 
evidence thatXschools or districts differ in the extent to which they effec- 
tively train titeir personnel. Several studies have found thSt teachers of 
potentially higher quality (based on acievement test scored,. for example) 
may select certainNschools and districts over others. This v iatter finding, 
however, has little 15b do with school characteristics other than perhaps 
their physical proximity <e.g., inner-city versus suburban) . Thus, in terms 
of personnel selection and training, there is little evidence to suggest * • 

V '-11*4. ' "• ' ' '■: . 
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that between-sdhool variance wil'l^e greater, than wi thin-school variance , 
• other! than' that which" is related to background, characteristics of teachers* 
. The higher level of data 'aggregation (i.e."', to the school level) for teacher 

f 1 • 

and administrative characteristics thus -uses a mean value to represent 
such characteristics when there is a great likelihood that the majority of 
students from any one school or district do not' 'receive the "average" level 
of these characteristics, Madaus etjil. (1980) state that teacher charac- 
teristics have been aggregated to the school level in "virtually every study 
of differential school ef f ec'tiveness . . . " "(198fl^p. -90). The poor predicta- 
bility in these studies for teacher and other, school-related effects (e.g., 
resources and facilities) is certainly explainable given the level of data 
aggregation consistently used in such studies. 

We believe the conclusions of Coleman. $fc-al. (1966), Jencks et* al. 

« » 

(1972),' Levine and Batje (J 975) and others regarding the effects of schooling 
are unwarranted given 'the designs and methods employed to study effects- 
In our review of the literature , we_ failed to- find an experimental or quasi- • 
experimental design that -was adequately sensitive to be able to partial but 
•the effects of intuitively appealing, school related- variables. 

Applications of models of organizational effectiveness should only be 
empirically tested once the issues of data aggregation, the_cOTstruct vali-"" 5 ** 3 ^ 
dity of criteria for school outcomes, and adequate sample sizes are' consid- 
ered thoroughly. Before t^hese critical issues are addressed, however, of 
paramount .concern for~fesearchers on. school effectiveness are the objectives 
or purposes for schooling. Until fhereis understanding" on this most com- 
plicated of; issues, researchers are in a position succintly captured by the 
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following passage: * * 
. "More than any other time in our history, 'mankind faces a 

- % , crossroads* One patl* leads to despair and uttfei: hopelessness. 
"The other^tp total extinction.. Let us pray that we have the 
wisdom to choope correctly (Allen, -1980 , p-. 57) . 
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fable 1 * • 



Applicability of Goal-Oriented Models to School Effectiveness' 



MODEL 



THEORETICAL 
REFERENCE 



FOCUS 



EDUCATIONAL 
EXAMPLE 



OUTCOMES 



( PROBLEMS WHEN 

"APPLIED TO EDUC ATION 

^ — 



FEATURES APPLICABLE 
J TO EDUCATION 



Rational- 
Goal 



Etzioni 
(1964); Per- 
row (1961) 



Effectiveness "de- 
fined by achieve- 
ment of prescribed 
goals • 



Blaschke 

(1972); 

Gramlich 

Koshel 

(1975) 



Pupil gain sqore 
on: standardized 
norm-referenced 
achievement and 



/ffeglects conflicting 
5 goals of multiple con- 
^ stituencies; little 
evidence to support 
ability testa; cri- performance contract- 
terion-r referenced ing. 
tests; curriculum- ^ 
based tests* - 



Formation of dominant 
coalitions to concil- 
iate" conflicts; go^ls 
can be set for non- 
cognitive factors as * 
well. ( 



Management- Drucker 
by-Ob jec- (1954) 
tives 



Effectiveness meas- Altergott 



ured by attain- 
ment of specific 
goals. 



(1970); 
Eads (1974); 
Shetty 
Carlirfe 
(1974) 



Pupil gain score 
on : 8 tandaridized 
normtreferenced 
achievement and 
ability tggts^ cri- 
ter ioh-refllteenc ed 
tests; ciJpiculumA 
based tests. Vl 



Focuses measurement 
on more easily quan- 
tifiable objectives; 
not easily tied in 
With individual re- 
wards • 



Limited applications 
to education nkve 
been positive. 



Functional Parsons 
(1960) 



Do organizational HanusTiek 
needs serve client (1977) 
groups? 

i,- 



x $ 



,Pupil gain scpre 
on : 8 tandardized 
norm-ref etenced 
achievement and 
ability tests; cri- 
, ier ion-referenced 
tests'; * curriculum- 
based tests; rat- 
ings of behavior . - 



Lit tle empir ical sup- Considers conflicting 

port to justify "paff^ "client" groups, in 

tern maintenance" goal attainments 

functions toward goal 

attainment, unidirec- 

tiqnality olc in-- 

fluence on client 

groups,} goal measure- . 

tnent. 



Cost- \ Rivlin* r 
Benefit (19^1) ° 
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V- 



Vfiffi^lencJ; tKe Wolfe 
.'centra^, variable, J 19771; 



Paul (31973) 





Purer cost measures- 
expenditure per 
pupil; Workload 
measures-number vof 
teachers^ per piipil; 
Physical standards- 
students per class- 
room; Pupil gain 
scores- training > 
turnover, costs. 



— > ' 

Measuringr^efficiency; Aid in fiscal deci- 
effects on'non-meas- sion-making; relative 
ured factors; com- - program evaluation, 
pqsit^ criterion meas-/ * " * 

urement. * * 
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Table 2 



Applicability of Systems-Models to School Effectiveneafe 



MODEL 



THEORETICAL 
REFERENCE 



FOCUS 



EDUCATIONAL 
EXAMPLE 



PROBLEMS WHEN FEATURES APPLICABLE 

OUTCOMES APPLIED TO EDUCATION TO EDUCATION 



Systems- 
Resource 



Katz & Kahn 
(1978); 
Tuchtman & 
Seashore 
(1967) • 



Effectiveness stud- 
ied in terms of 
efficiency or ex- 
ploitation. * 



Levin OutRutAnput ra- 

(1976); . tio Efficiency); 
Klitgaard f number of grad- 
(1975); Fin- uates; percent of 
ch§r (1972) unemployed, grad- 
uates; ability to 
compete for val- 
ued resources. 



Identifying an aaoegte- Cpnsideratiori of 
able standard of output measures in 

efficiency. context of supra- 

sys^n^ 



Functional- Penning* 
Structures (1975) 



Effectiveness a 
function of tech- 
nological struc- 
tural interac- 
tions. ' 



Mohr (1973); 

Grayson 

(1972) 



Formalization; 
•bureaucratic 1 
structure; climate; 
leader behavior; 
motivational 
forces • 



Concern with organi- 
zational security 
and^ continuity of 
policy; profitabil- 
ity most common cri- 
terion . 



Relationship consid- 
ered between^ teacher 
evaluative structures 
and output measures. 



Managerial Reiman 



T rocess 



(1975);. 
Cyert - 
March* (1963) 



Effectiveness C9n-, Barro Teacher loyalty 

sidered in context '(1970); and morale; teach 

-of -managerial func- Dyer. (1970); er Satisfaction.' ships between mkna- 
tions, abilities, Vee (1973) ferial behavior and 

and behaviors . . • ^ output variably . ^ 



Little empirical sup- Methodologies pro- 
por£ for rcda^oni posed to study school 

administrator behavior; 
managerial dimensions 
identified that may 
be applicable. 



r Organiza- Beckhard 
\ tiorial De-« (1969); 
* velopment French _ 
(1972& Ben- 
% - / nis (1969) 



'Effectiveness as- Radnor 
sufled given certain (1974); 
organizational bhar- Caprio 
aqteristics (e/g. f (1974) 
upward communica- 
tion, participation 
in decision-making) . 



Teacher satisfac- 
Di- tion;. reactive 

questionnaire* * 



Effectiveness not Relationship between 
measured in terms of "healthy" system and 
school output meas- teacher and student 
ures such as acHl6ve- output measures makes 
ment df non-co^nitiye good conceptual sense, 
variables. \ • 



Likert-ISR Likert (1967) 



Effectiveness as- 
sumed given high 
participative man- 
agement style. 



Austin 
(1979) 



Teacher, sa tifffac- « Effectiveness typical- System 4 management 
tion; student & ly not measured with proven effective in 
teacher morale; ' "hard 11 criteria. other service-oriented 

. non-profit organiza- ^ 

J[ l 49 t ^ onsJ also limited 



labor relations;^ 
intraorganizational 



communication & truslf; 
student performance (rare) • 



support in .education. 



SOURCE 



Table 3 

' •„ . ' Research With the Liker^-rlSR Model of Effectiveness 

* 

SAMPLE PQS FORM ■ RELATED TO 



RELATIONSHIP FOUND* 



•Gibson. (1974) Sixth grade boys Teachers, principals e Achievement test , Higher achievement test scores. 



8 core 8 



Key (1974) 



>„ ****** 



4 school districts 



'X 



- - — ^ - _ 

Board members; Super- Labor relations 
intendents; Adminis- - 
£rative members; ,J 
principals; teachers 



Teachers & Staff less likely to 
have "persistent disagreements". 



Hayties (1972) 10 school systems 



^oard members; Super- Teacher strikes 
in tend en ts; Adminis- 
trative staff; princi- 
pals J teachers, 



Less likely to strike (teachers), 



Bernhardt 
: (1972) . 



979 teachers 



Teacher 



Teacher militancy 



Less teacher militancy* 



^Uer*(1970) T 82> principals 

^^f^ y % 329 teachers % 
~* > ' 1099 stents ^ 

- • * * » 



Byrnes (1973) 



Principals, teachers, Motivation; Attitudes 
students & commitment to in- 

' " % stitution; Frustra- 

tion; Confidence & 
• * Trust, Communication 



•Higher motivation of students . 
fit teachers . - 

•More favorable attitudes & 
greater commitment v. „ ^ * 
• 'Less frustration "of teachers & 
students, 

• Greater confidence & trite t among 
. persons in the school. 
•Better communication in all 
directions. * 



Teacher 8. ih seven 
high schools * 



Teacher* 



Job satisfaction 



Greater job satisfaction. 
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* r • ' Table 3 (continued) 



. • SOURCE 


SAMPLE 


POS FORM 


RELATED XO 


RELATIONSHIP FOUND* 


Wagstaf f (1970) 


High schbQl teachers 

& nWn/t'lniil a * 

ft 


Teacher & principal 


Interpersonal needs 
of teachers 


B,et'ter teacher sense of need 
satisfaction. 


Smallrldge 
(4972) 


250 elementary ^ 
. teacher? „ * 


Teacher . . 


Need satisfaction 


Greater need satisfaction. 

i 


Carf (r971) 

t * 


* 94 high school ,\ 

principals 5 

• * * 


Principal 

9 


Satisfaction 

< 


Gteater satisfaction with their 
supervision, co-workers, work, 
pay & promotion. 


f 

Cullers, Hughes , Students J.n $ix 
^MdGreal (4973) ./K^h schools r 

J .... * s> v 


Principal & teacher 

v 0 
> 


Student satisfaction 


.Greater student satisfaction. 


Morall (1974) . 


106 H.S. teachers * % 

120 H.S. studenteL ^ r 

* < 


Teacher & students t . 


Teacher & studgfit 
morale I 


S o * * — — *-* 

Higher morale of students ancl 
teachers . 
J w 


Smith (1975) . * 
i « 


17 principals / 
254 teachers * 


^ 

Principal ' ^ 


• ; : ^ 

TeacHer morale, meas- 
ured by the Purdue 
Teacher Oplhionnaire 


Higher teacher morale, ^ 


Lepkowski * • 
(1970)' 

J * * 


"High school teachers 


Teacher 


Communication » 


Better communications in all 
* directions within the school. 


Hiedel'-(1974) ' ' 

t.t 

' « . V „ » '• ' \ A 

* * 


Elementary school . 
teachers- & principals 

• ; : ' 0 


Teacher , a ^ 
— Utr- 


. Evaluators 1 - judgment 
of v principals 


■ <? ' 
Principals evaluated higher 
were closer to System 4 schools. 

^ * ; • 


t t 

^Naumann-Etienne 
,(1975) * ' .. 


4 elementaty schools 

* - * 




"Open education" & 
traditional schools 


Ppon schools, closer to System 
4. • 

*^ 


• • 

v V -152. 
-ERLC . ; 


i 

f * 

-A.. . . 


. " • v . \ • 


* 

t ^ , 


« ^ IdJ* 

• • 

* < 
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00 



SOURCE 



SAMPLE 



Table 3 (continued^ 
POS FORM ' ; RELATED TO . RELATIONSHIP FOUND* 



Ladouceur 
(1973) 



523 teachers 



Teacher 



Schools capacity to Closer to System 4, the more 
* change capable the school was of 

° changing. 



Donlan (1978) ^18 schools * % Teacher 

6th grade' students 



School Achievement? Greater the PEP score ira- 
Scores N.Y. Staty proveraent. 
Pupil Evaluatiqpr 
/Program (PEP) 



Langland (1978) 613 teachers 



Tqaoher 



: : ~f~ 

Conflict, 'grievance 
rates 



Less conflict in negotiating 
contracts,: ho relationship 
with grievance rates • ♦ 



MacKillican 
(1975) 



469^K-5 teachenu 



Teacher 



c. 



Use of open educa- 
tion • ' • 



Higher t;he openness of the 
classroom. 



Weeks (1978) 



1403. principals and 
teachers in 33 
' schools 



Teacher 



Organizational cli- 
4 rtate* measured by 
*the Profile of Con- 
flict Characteristics 



Closer teachers saw . the principal's 



conflict mahagemeA 



and behavior. 



Horsman (1973) 14 principals, 8 Vice Principal^ teachers, Educational per- 
principals, 206 students formance 

• teachers, 912 students 

, /_ . it * c~ 

Freeman, Martin 2056 teachers, princi- Teacher, principal, Satisfaction & 
& Roney* (1980} ^pals & office staff C|jitral Office -Staff militancy 



No Significant correlation between 
POS scores and educational per- 
formance ♦ • 



Highet System -4 « greater satis- 
faction less militancy for air 
groups. * / ' 



Cullers (1970) 



ERJC 
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37 Superintendents 
- *44 Secondary, princi- 
pals; 78 Elementary 
principals 



Superintendent , 
^principal 



Position in hierar- 
chy 



Superintendents perceive themselves 
as low System 4; Principals perceive 
themselves as high System 3, of 
elementary principals closer to 
System 4. , - , ^ _ J55 



